-- Logs begin at Thu 2022-08-18 23:57:50 UTC, end at Fri 2022-08-19 01:42:02 UTC. -- Aug 19 01:09:37.747375 dv-osbrick-852824-2-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 19 01:09:37.757790 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 19 01:09:37.760590 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 01:09:37 2022] *** Aug 19 01:09:37.760590 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 01:09:37.760590 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 01:09:37.760590 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: nodename: dv-osbrick-852824-2-ceph Aug 19 01:09:37.760590 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: machine: x86_64 Aug 19 01:09:37.760590 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: clock source: unix Aug 19 01:09:37.760590 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: pcre jit disabled Aug 19 01:09:37.760590 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: detected number of CPU cores: 4 Aug 19 01:09:37.760590 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: current working directory: / Aug 19 01:09:37.760590 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: detected binary path: /usr/bin/uwsgi-core Aug 19 01:09:37.761257 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: your processes number limit is 47680 Aug 19 01:09:37.761257 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: your memory page size is 4096 bytes Aug 19 01:09:37.761257 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: detected max file descriptor number: 2048 Aug 19 01:09:37.761257 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: lock engine: pthread robust mutexes Aug 19 01:09:37.761257 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: thunder lock: enabled Aug 19 01:09:37.761257 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 19 01:09:37.761257 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 01:09:37.807380 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: Python main interpreter initialized at 0x55ee9634b9c0 Aug 19 01:09:37.807380 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: python threads support enabled Aug 19 01:09:37.807380 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: your server socket listen backlog is limited to 100 connections Aug 19 01:09:37.807380 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: your mercy for graceful operations on workers is 90 seconds Aug 19 01:09:37.807679 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 01:09:37.807754 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: *** Operational MODE: preforking *** Aug 19 01:09:37.807985 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: *** uWSGI is running in multiple interpreter mode *** Aug 19 01:09:37.807985 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: spawned uWSGI master process (pid: 88715) Aug 19 01:09:37.808181 dv-osbrick-852824-2-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 19 01:09:37.809549 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: spawned uWSGI worker 1 (pid: 88725, cores: 1) Aug 19 01:09:37.809549 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: spawned uWSGI worker 2 (pid: 88726, cores: 1) Aug 19 01:09:37.809549 dv-osbrick-852824-2-ceph devstack@keystone.service[88715]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 01:09:42.586148 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 01:09:42.586148 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: from cryptography.utils import int_from_bytes Aug 19 01:09:42.587039 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 01:09:42.587039 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: from cryptography.utils import int_from_bytes Aug 19 01:09:42.590245 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 01:09:42.590245 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: from cryptography.utils import int_from_bytes Aug 19 01:09:42.590705 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 01:09:42.590705 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: from cryptography.utils import int_from_bytes Aug 19 01:09:42.638200 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 01:09:42.638398 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 01:09:42.638593 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] command line args: [] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 01:09:42.638875 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 01:09:42.639054 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ================================================================================ {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 01:09:42.639309 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] admin_token = **** {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.639558 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] config_dir = [] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.639749 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.639934 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] config_source = [] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.640116 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] debug = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.640288 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 01:09:42.640367 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.640581 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 01:09:42.640651 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] command line args: [] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 01:09:42.640710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.640878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.640973 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 01:09:42.641131 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ================================================================================ {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 01:09:42.641245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.641380 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.641482 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] admin_token = **** {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.641615 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] list_limit = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.641716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] config_dir = [] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.641824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] log_config_append = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.641925 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.642020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.642154 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] config_source = [] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.642264 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] log_dir = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.642365 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] debug = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.642473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] log_file = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.642575 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.642680 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.642796 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.642796 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.642988 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.643068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.643144 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.643259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.643332 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.643693 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.643775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] list_limit = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.643853 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.643973 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] log_config_append = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.644053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.644129 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.644204 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] log_dir = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.644326 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.644407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] log_file = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.644530 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.644608 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.644735 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.644823 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.645003 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.645082 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.645240 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.645323 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.645445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.645528 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.645605 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.645734 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.645809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.645992 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.646074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.646278 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.646495 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.82/identity {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.646582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.646680 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] publish_errors = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.646766 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.646915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.646990 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.647147 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.647224 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.647327 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.647407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.647576 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.647657 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.647816 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.648054 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] standard_threads = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.648200 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.82/identity {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.648279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.648351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] publish_errors = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.649365 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.649471 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.649534 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.649534 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] use_journal = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.649534 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] use_json = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.649721 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.649793 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] use_stderr = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.649857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.649932 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] use_syslog = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.649932 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.650062 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.650062 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.650197 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.650272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] standard_threads = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.650345 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.650415 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.650484 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.650553 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.650628 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.650698 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.650824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.650900 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] use_journal = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.651034 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] use_json = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.651109 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.651254 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] use_stderr = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.651327 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.651401 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] use_syslog = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.651531 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.651607 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 01:09:42.651782 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.651866 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.652031 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.652112 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.652285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.652413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.652567 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.652653 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.652761 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.652838 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.653024 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.653107 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.653274 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.653364 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.653513 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.653597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.653751 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.653835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.653998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.654086 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.654246 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.654324 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.654482 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.654558 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.654719 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.654795 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.654956 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.655037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.655204 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.655286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.655452 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.655530 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.655691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.655767 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.655928 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.656004 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.656163 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.656240 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.656397 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.656477 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.656636 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.656711 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.656891 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.656967 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.657144 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.657221 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.657378 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.657454 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.657614 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.657696 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.657857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.657938 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.658090 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.658172 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.658322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.658398 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.658560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.658642 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.658794 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.658875 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.659035 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.659117 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.659264 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.659338 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.659495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.659570 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.659727 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.659803 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.659961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.660046 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.660194 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.660270 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.660435 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.660518 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.660671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.660752 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.660930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.661042 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.661166 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.661249 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.661398 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.661475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.661628 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.661705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.661858 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.661941 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.662088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.662164 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.662325 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.662412 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.662567 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.662650 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.662796 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.662880 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.663034 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.663113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.663264 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.663350 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.663500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.663577 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.663730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.663812 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.663975 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.664062 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.664785 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.665010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.665132 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.665265 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.665407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.665549 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.665641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.665777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.665855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.666011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.666087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.666253 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.666331 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.666492 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.666574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.666774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.666866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.666988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.667066 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.667227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.667304 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.667462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.667550 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.667700 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.667777 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.667938 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.668015 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.668168 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.668244 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.668409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.668486 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.668646 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.668722 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.668904 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.668984 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.669149 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.669224 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.669387 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.669465 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.669629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.669711 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.669865 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.669948 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.670104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.670189 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.670343 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.670420 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.670593 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.670670 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.670833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.670918 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.671072 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.671147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.671314 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.671398 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.671555 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.671632 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.671792 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.671870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.672028 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.672112 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.672267 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.672349 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.672502 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.672579 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.672737 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.672825 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.672992 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.673080 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.673232 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.673315 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.673467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.673551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.673710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.673823 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.673949 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.674071 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.674199 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.674314 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.674440 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.674558 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.674705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.674783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.674966 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.675050 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.675209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.675286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.675444 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] auth.external = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.675520 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.675676 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.675760 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.675917 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.675993 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.676157 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.676234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.676409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.676493 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] auth.password = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.676641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] auth.token = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.676717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.676909 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.676989 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.677154 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.677241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.677402 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.677516 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.677638 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] auth.external = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.677754 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.677877 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.677999 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.678180 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.678272 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.678408 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.678487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.678642 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] auth.password = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.678721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] credential.caching = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.678875 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] auth.token = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.678961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.679118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.679195 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.679356 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.679440 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.679603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.679688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.680524 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.680759 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.680875 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.681148 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.681235 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.681406 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.681486 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.681643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.681720 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.681888 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] credential.caching = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.681975 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.682138 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.682251 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.682389 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.682501 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.682637 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.682768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.682877 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.683018 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.683122 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.683278 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.683357 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.683519 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] federation.caching = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.683603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.683760 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.683837 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.684010 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.684087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.684262 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.684342 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.684495 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.684578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.684742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.684820 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.685012 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.685093 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.685271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.685351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.685514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.685591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.685773 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.685852 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] federation.caching = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.686011 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.686089 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.686260 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.686338 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.686498 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity.caching = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.686581 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.686728 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.686810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.686975 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.687064 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.687213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.687291 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.687450 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.687542 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.687694 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.687778 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.687929 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.688007 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.688173 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.688253 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.688421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.688500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.688657 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity.caching = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.688736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.688921 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.689001 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.689158 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.689235 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.689393 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.689471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.689629 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.689707 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.689876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.689952 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.690106 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.690183 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.690344 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.690421 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.690593 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.690678 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.690845 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.690924 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.691078 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.691156 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.691312 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.691389 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.691544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.691621 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.691785 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.691862 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.692019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.692100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.692257 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.692335 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.692501 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.692576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.692743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.692827 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.693017 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.693095 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.693252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.693329 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.693492 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.693583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.693726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.693803 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.693964 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.694039 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.694193 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.694277 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.694428 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.694510 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.694668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.694744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.694906 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.694990 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.695137 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.695213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.695416 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.695491 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.695732 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.696066 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.696189 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.696312 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.696438 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.696589 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.696707 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.696839 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.696993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.697114 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.697235 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.697356 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.697488 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.697629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.697751 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.697871 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.697991 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.698111 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.698232 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.698360 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.698481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.698601 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.698721 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.698841 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.698961 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.699088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.699222 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.699344 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.699464 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.699584 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.699705 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.699852 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.699971 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.700092 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.700213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.700333 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.700454 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.700600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.700725 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.700914 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.701048 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.701174 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.701298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.701433 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.701557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.701681 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.701805 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.701929 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.702051 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.702183 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.702307 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.702432 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.702555 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.702685 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.702815 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.702949 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.703073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.703197 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.703321 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.703445 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.703568 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.703699 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.703824 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.703824 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.704059 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.704183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.704306 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.704451 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.704576 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.704700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.704823 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.704963 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.705085 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.705218 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.705338 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.705459 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.705580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.705699 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.705820 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.705949 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.706080 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.706201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.706321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.706442 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.706563 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.706690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.706812 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.706932 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.707053 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.707173 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.707292 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.707421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.707542 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.707662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.707791 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.707913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.708105 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.708229 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.708349 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.708471 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.708591 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] resource.caching = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.708712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.708839 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.708981 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.709106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.709231 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.709355 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.709480 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.709622 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.709748 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.709872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.710051 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.710170 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.710295 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.710427 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.710553 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.710682 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.710799 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.710920 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.711044 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] resource.caching = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.711252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] role.caching = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.711380 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.711512 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] role.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.711635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.711756 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.711877 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.712006 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.712128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.712249 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.712372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.712492 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.712614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.712742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.712742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.713018 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.713153 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.713278 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.713403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.713538 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.713664 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.713788 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] role.caching = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.713912 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.714035 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] role.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.714159 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.714296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.714422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.714546 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.714670 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.714794 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.714928 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.715060 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.715060 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.715296 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.715419 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.715544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.715669 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.715800 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.715925 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.716049 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.716173 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.716296 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.716419 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.716583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.716704 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.716828 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.716971 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.717047 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.717131 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.717221 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.717294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.717364 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.717364 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.717490 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.717568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.717640 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.717710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.717779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.717856 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.717927 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.718005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.718076 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.718145 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.718221 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.718292 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.718362 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.718439 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.718510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.718580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.718649 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.718718 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] token.caching = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.718787 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.718865 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.718936 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.719006 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.719075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.719150 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.719221 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.719341 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.719421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.719587 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.719674 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.719828 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.719905 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.720077 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.720156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.720313 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.720390 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.720547 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.720624 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.720783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] token.caching = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.720894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.721048 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.721126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.721286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.721363 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.721521 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.721599 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.721775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.721853 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.722008 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.722084 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.722246 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.722324 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.722490 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.722567 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.722734 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.722812 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.connection = **** {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.722982 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.723072 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.723221 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.723298 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.723459 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.723536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.723693 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.723778 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.723939 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.724016 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.724179 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.724254 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.724409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.724493 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.724646 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.724723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.724935 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.725018 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.725180 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.725277 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.connection = **** {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.725432 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.725521 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.725674 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.725751 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.725911 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.725988 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.726151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.726298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.726373 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.726443 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.726615 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.727189 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.727441 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.727753 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.727887 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.727966 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 01:09:42.728153 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.728403 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.728644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.728914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.729154 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.729403 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.729639 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.729887 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.730119 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.730358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.730593 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 01:09:42.730763 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 01:09:42.757523 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.757755 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.758015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.760295 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.760529 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.760766 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.766561 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.769501 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.796330 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.796497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.796581 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.796726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.849138 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.849775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.907230 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.907463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.907791 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.908031 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.978883 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.979107 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.979334 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.979560 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.979641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.979783 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.979865 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.980003 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.980085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.980239 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.980461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:42.980679 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.003042 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.003219 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.003304 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.003450 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.003530 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.003658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.003741 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.003875 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.003956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.004088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.004171 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.004330 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.004419 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.004519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.015984 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.016632 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.029454 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.029690 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.029920 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.030156 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.030377 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.030591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.030674 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.030803 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88725) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.030883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.031043 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.031267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.031485 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.031701 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.031914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88726) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 01:09:43.048162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.048378 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 01:09:43.048461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.048624 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 01:09:43.048727 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.048954 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 01:09:43.049037 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.049181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 01:09:43.049262 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.049462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.049543 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.049731 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.049813 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.049992 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.050070 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.050253 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.060291 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.060580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.060827 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.060927 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.061138 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.061220 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.061416 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.061711 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.068134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.068664 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.071723 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.072010 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.072296 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.072583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.072706 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.072892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.073030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.073174 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.073295 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.073423 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.073549 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.073676 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.073810 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.073949 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.074077 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.074228 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.074314 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.074502 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.074588 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.074841 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.075118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.075388 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.099397 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.099678 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.100819 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.101133 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.101223 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.101464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.106805 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.106906 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.107096 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.107180 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.107384 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.108995 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.113892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.114188 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.115430 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.115721 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.118986 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.119282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.119574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.119878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.120163 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.120453 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.120732 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.120884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.121049 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.121175 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.121454 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.121848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.122137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.122442 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.122730 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.123014 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.137366 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.137659 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.139815 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.140101 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.141564 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.144284 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.145102 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.145408 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.147426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.147839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.150187 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.152663 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.153389 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.155840 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.156619 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.156953 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.157246 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.157537 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.157823 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.158128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.158984 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.159290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.159590 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.159988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.160290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.160587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.174248 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.174543 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.174819 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.175108 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.177177 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.177473 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.177747 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.178015 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.182554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.184106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.184392 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.185855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.187092 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.187384 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.187509 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.187684 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.187813 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.187971 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.188258 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.190577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.190867 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.191162 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.191447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.191738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.200343 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.200633 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.200947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.201243 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.201531 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.201814 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.202098 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.204242 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.204531 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.204816 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.205130 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.205428 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.205724 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.206008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.217772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.220828 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.222022 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.223775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.224969 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.225241 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.226767 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.227120 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.227421 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.228584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.230058 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.231543 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.231831 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.232138 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.234042 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.235552 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.238483 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.238696 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.238782 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.239074 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.239374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.240171 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.244177 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.244475 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.244765 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.245080 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.250226 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.250533 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.250869 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.253093 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.253389 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.253672 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.257917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88725) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.258795 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.259128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.259420 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.259704 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.259987 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.260285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.260560 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.260834 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.261137 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.261420 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.261630 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88726) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 01:09:43.261712 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.261978 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.262246 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88725) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.262998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.263296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.263587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.263880 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.264167 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.264453 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.264734 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.265051 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.265333 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.265630 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.265901 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.266181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.266448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88726) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 01:09:43.295901 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ee9634b9c0 pid: 88725 (default app) Aug 19 01:09:43.299429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b6ceb-881a-40e6-9956-c8ef8a01242e None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:43.299724 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b6ceb-881a-40e6-9956-c8ef8a01242e None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:43.300000 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b6ceb-881a-40e6-9956-c8ef8a01242e None None] PATH_INFO: `/v3` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:43.301219 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ee9634b9c0 pid: 88726 (default app) Aug 19 01:09:43.304178 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 1/1] 10.222.0.82 () {50 vars in 791 bytes} [Fri Aug 19 01:09:43 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:09:51.202936 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1181f5-bd6e-4c85-b644-2308b0c30f77 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:51.203467 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1181f5-bd6e-4c85-b644-2308b0c30f77 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:51.203572 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1181f5-bd6e-4c85-b644-2308b0c30f77 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:51.207821 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 1/2] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:09:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:09:51.213725 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1562ba-e8aa-49a3-8c7b-f9550311ce4d None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:51.214144 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1562ba-e8aa-49a3-8c7b-f9550311ce4d None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:51.214273 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1562ba-e8aa-49a3-8c7b-f9550311ce4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:51.292348 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: INFO dbcounter [None req-4b1562ba-e8aa-49a3-8c7b-f9550311ce4d None None] Registered counter for database keystone Aug 19 01:09:51.312010 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG oslo_db.sqlalchemy.engines [None req-4b1562ba-e8aa-49a3-8c7b-f9550311ce4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 01:09:51.318428 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writer thread running {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 01:09:51.497378 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG passlib.handlers.bcrypt [None req-4b1562ba-e8aa-49a3-8c7b-f9550311ce4d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88725) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 01:09:51.497704 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG passlib.handlers.bcrypt [None req-4b1562ba-e8aa-49a3-8c7b-f9550311ce4d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88725) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 01:09:51.552154 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-4b1562ba-e8aa-49a3-8c7b-f9550311ce4d None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:09:51.553787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-4b1562ba-e8aa-49a3-8c7b-f9550311ce4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:09:51.686101 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 2/3] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:09:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 01:09:52.230852 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1181f5-bd6e-4c85-b644-2308b0c30f77 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:09:52.308107 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: INFO dbcounter [None req-ea1181f5-bd6e-4c85-b644-2308b0c30f77 None None] Registered counter for database keystone Aug 19 01:09:52.329418 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG oslo_db.sqlalchemy.engines [None req-ea1181f5-bd6e-4c85-b644-2308b0c30f77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 01:09:52.335609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writer thread running {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 01:09:52.457701 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1181f5-bd6e-4c85-b644-2308b0c30f77 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:09:52.461980 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba86194-b8a8-44f1-9c47-f27dd81755fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:09:52.462608 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba86194-b8a8-44f1-9c47-f27dd81755fb admin admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:52.462889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba86194-b8a8-44f1-9c47-f27dd81755fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:52.463849 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba86194-b8a8-44f1-9c47-f27dd81755fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:52.472295 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba86194-b8a8-44f1-9c47-f27dd81755fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:09:52.525107 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fba86194-b8a8-44f1-9c47-f27dd81755fb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 01:09:52.525396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba86194-b8a8-44f1-9c47-f27dd81755fb admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:09:52.535846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 2/4] 10.222.0.82 () {58 vars in 1324 bytes} [Fri Aug 19 01:09:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 01:09:52.542623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1562ba-e8aa-49a3-8c7b-f9550311ce4d None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:09:52.560122 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1562ba-e8aa-49a3-8c7b-f9550311ce4d None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:09:52.564529 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ce62c-f854-4c0d-a842-3a17edc85d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:09:52.565689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ce62c-f854-4c0d-a842-3a17edc85d0f admin admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:52.565973 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ce62c-f854-4c0d-a842-3a17edc85d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:52.566254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ce62c-f854-4c0d-a842-3a17edc85d0f admin admin] PATH_INFO: `/v3/projects/cd377ed4c2f045fc8b576211274579df` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:52.567693 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ce62c-f854-4c0d-a842-3a17edc85d0f admin admin] RBAC: Authorizing `identity:get_project(project_id=cd377ed4c2f045fc8b576211274579df)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:09:52.618738 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: WARNING keystone.common.rbac_enforcer.enforcer [None req-305ce62c-f854-4c0d-a842-3a17edc85d0f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 01:09:52.619088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ce62c-f854-4c0d-a842-3a17edc85d0f admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:09:52.624232 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 3/5] 10.222.0.82 () {56 vars in 1207 bytes} [Fri Aug 19 01:09:52 2022] GET /identity/v3/projects/cd377ed4c2f045fc8b576211274579df => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:09:54.833819 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12441085-4cf1-4a2f-8d02-e076be820af8 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:54.834297 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12441085-4cf1-4a2f-8d02-e076be820af8 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:54.834297 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12441085-4cf1-4a2f-8d02-e076be820af8 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:54.838586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 3/6] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:09:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:09:54.844603 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a489182-c53e-4f18-87c0-13f43d6316a9 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:54.845039 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a489182-c53e-4f18-87c0-13f43d6316a9 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:54.845170 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a489182-c53e-4f18-87c0-13f43d6316a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:54.864585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-7a489182-c53e-4f18-87c0-13f43d6316a9 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:09:54.866131 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-7a489182-c53e-4f18-87c0-13f43d6316a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:09:54.874123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 4/7] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:09:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 01:09:55.203322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12441085-4cf1-4a2f-8d02-e076be820af8 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:09:55.215914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12441085-4cf1-4a2f-8d02-e076be820af8 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:09:55.220133 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79405c-336d-46e8-9fef-e2e156e0780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:09:55.220727 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79405c-336d-46e8-9fef-e2e156e0780a admin admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:55.221042 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79405c-336d-46e8-9fef-e2e156e0780a admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:55.221316 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79405c-336d-46e8-9fef-e2e156e0780a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:55.228883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79405c-336d-46e8-9fef-e2e156e0780a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:09:55.230662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79405c-336d-46e8-9fef-e2e156e0780a admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:09:55.239265 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 4/8] 10.222.0.82 () {58 vars in 1324 bytes} [Fri Aug 19 01:09:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 01:09:55.245199 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a489182-c53e-4f18-87c0-13f43d6316a9 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:09:55.254185 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a489182-c53e-4f18-87c0-13f43d6316a9 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:09:55.258482 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa53352-c53a-4537-89c5-093abfff7dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:09:55.259099 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa53352-c53a-4537-89c5-093abfff7dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:55.259377 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa53352-c53a-4537-89c5-093abfff7dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:55.259650 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa53352-c53a-4537-89c5-093abfff7dc3 admin admin] PATH_INFO: `/v3/users/93e416b080ca43b493d7d04aa867adf6` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:55.261631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa53352-c53a-4537-89c5-093abfff7dc3 admin admin] RBAC: Authorizing `identity:get_user(user_id=93e416b080ca43b493d7d04aa867adf6)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:09:55.263481 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa53352-c53a-4537-89c5-093abfff7dc3 admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:09:55.264993 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 5/9] 10.222.0.82 () {56 vars in 1198 bytes} [Fri Aug 19 01:09:55 2022] GET /identity/v3/users/93e416b080ca43b493d7d04aa867adf6 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:09:57.522950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce29d93-f2a1-4d6b-adc9-8acb4f53cdd3 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:57.523556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce29d93-f2a1-4d6b-adc9-8acb4f53cdd3 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:57.523556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce29d93-f2a1-4d6b-adc9-8acb4f53cdd3 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:57.524817 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 5/10] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:09:57.530674 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b49b-6aba-443c-a981-5fdd74409433 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:57.531092 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b49b-6aba-443c-a981-5fdd74409433 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:57.531382 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b49b-6aba-443c-a981-5fdd74409433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:57.550231 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189c4ea-e5a2-4fe6-adb4-9448eefcd17c None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:57.550539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189c4ea-e5a2-4fe6-adb4-9448eefcd17c None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:57.550788 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189c4ea-e5a2-4fe6-adb4-9448eefcd17c None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:57.550885 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-72e0b49b-6aba-443c-a981-5fdd74409433 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:09:57.552053 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-72e0b49b-6aba-443c-a981-5fdd74409433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:09:57.552163 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 6/11] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:09:57.557243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03ad62-517e-4007-ade3-8a4472ae6750 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:57.557602 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03ad62-517e-4007-ade3-8a4472ae6750 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:57.557888 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03ad62-517e-4007-ade3-8a4472ae6750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:57.599819 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG passlib.handlers.bcrypt [None req-be03ad62-517e-4007-ade3-8a4472ae6750 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88726) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 01:09:57.600237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG passlib.handlers.bcrypt [None req-be03ad62-517e-4007-ade3-8a4472ae6750 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88726) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 01:09:57.647074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-be03ad62-517e-4007-ade3-8a4472ae6750 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:09:57.648738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-be03ad62-517e-4007-ade3-8a4472ae6750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:09:57.745215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 6/12] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:09:57.754864 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 7/13] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:09:58.073562 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0b49b-6aba-443c-a981-5fdd74409433 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:09:58.081073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03ad62-517e-4007-ade3-8a4472ae6750 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:09:58.098241 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:09:58.184420 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0b49b-6aba-443c-a981-5fdd74409433 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:09:58.185092 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03ad62-517e-4007-ade3-8a4472ae6750 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:09:58.187397 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:09:58.222803 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88945e0a-19db-48e9-831d-9cb72fc51ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:09:58.223447 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88945e0a-19db-48e9-831d-9cb72fc51ba9 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:58.223728 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88945e0a-19db-48e9-831d-9cb72fc51ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:58.223904 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a97b75-d610-4747-82f1-20fba5a9d1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:09:58.224011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88945e0a-19db-48e9-831d-9cb72fc51ba9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:58.224758 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97b75-d610-4747-82f1-20fba5a9d1cd None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:58.225068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97b75-d610-4747-82f1-20fba5a9d1cd None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:58.225342 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97b75-d610-4747-82f1-20fba5a9d1cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:58.236431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88945e0a-19db-48e9-831d-9cb72fc51ba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:09:58.244903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-88945e0a-19db-48e9-831d-9cb72fc51ba9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:09:58.244903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:09:58.244903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:09:58.244903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:09:58.244903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:09:58.244903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:09:58.244903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:09:58.244903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:09:58.244903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:09:58.244903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:09:58.244903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:09:58.244903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:09:58.244903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:09:58.244903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:09:58.244903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:09:58.244903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:09:58.245829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:09:58.245829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:09:58.245829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:09:58.245829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:09:58.245829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:09:58.245829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:09:58.245829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:09:58.245829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:09:58.245829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:09:58.245829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:09:58.245829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:09:58.245829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:09:58.245829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:09:58.245829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:09:58.245829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:09:58.245829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:09:58.246655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:09:58.246655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:09:58.246655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:09:58.246655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:09:58.246655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:09:58.246655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:09:58.246655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:09:58.246655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:09:58.246655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:09:58.246655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:09:58.246655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:09:58.246655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:09:58.246655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 7/14] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:09:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:09:58.252069 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88945e0a-19db-48e9-831d-9cb72fc51ba9 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:09:58.299834 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a97b75-d610-4747-82f1-20fba5a9d1cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:09:58.301417 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a97b75-d610-4747-82f1-20fba5a9d1cd None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:09:58.340585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:09:58.358883 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88945e0a-19db-48e9-831d-9cb72fc51ba9 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:09:58.393493 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa70d2-7b87-4fe6-bcc4-e294711a3072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:09:58.399086 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa70d2-7b87-4fe6-bcc4-e294711a3072 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:58.399086 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa70d2-7b87-4fe6-bcc4-e294711a3072 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:58.399086 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa70d2-7b87-4fe6-bcc4-e294711a3072 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:58.399086 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa70d2-7b87-4fe6-bcc4-e294711a3072 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:09:58.399086 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa70d2-7b87-4fe6-bcc4-e294711a3072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:09:58.399086 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa70d2-7b87-4fe6-bcc4-e294711a3072 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:09:58.399503 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 8/15] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 01:09:58.405667 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a97b75-d610-4747-82f1-20fba5a9d1cd None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:09:58.409281 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:09:58.409850 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 8/16] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:09:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:09:58.415406 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa70d2-7b87-4fe6-bcc4-e294711a3072 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:09:58.507427 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a97b75-d610-4747-82f1-20fba5a9d1cd None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:09:58.521356 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa70d2-7b87-4fe6-bcc4-e294711a3072 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:09:58.544728 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839e0b4-34e1-4cda-a024-1182c37cdd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:09:58.545640 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839e0b4-34e1-4cda-a024-1182c37cdd58 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:58.545921 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839e0b4-34e1-4cda-a024-1182c37cdd58 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:58.546194 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839e0b4-34e1-4cda-a024-1182c37cdd58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:58.556004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace7a7f-6b76-4d47-b12f-f5409b1b93a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:09:58.556642 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace7a7f-6b76-4d47-b12f-f5409b1b93a7 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:58.557143 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace7a7f-6b76-4d47-b12f-f5409b1b93a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:58.557603 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace7a7f-6b76-4d47-b12f-f5409b1b93a7 None admin] PATH_INFO: `/v3/users/93e416b080ca43b493d7d04aa867adf6` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:58.558864 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace7a7f-6b76-4d47-b12f-f5409b1b93a7 None admin] RBAC: Authorizing `identity:get_user(user_id=93e416b080ca43b493d7d04aa867adf6)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:09:58.560337 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace7a7f-6b76-4d47-b12f-f5409b1b93a7 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:09:58.561969 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 9/17] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:09:58 2022] GET /identity/v3/users/93e416b080ca43b493d7d04aa867adf6 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:09:58.567296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839e0b4-34e1-4cda-a024-1182c37cdd58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:09:58.567424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace7a7f-6b76-4d47-b12f-f5409b1b93a7 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:09:58.568770 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839e0b4-34e1-4cda-a024-1182c37cdd58 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:09:58.584143 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:09:58.587413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-c839e0b4-34e1-4cda-a024-1182c37cdd58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:09:58.587413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:09:58.587413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:09:58.587413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:09:58.587413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:09:58.587413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:09:58.587413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:09:58.587413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:09:58.587413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:09:58.587413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:09:58.587413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:09:58.587413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:09:58.587413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:09:58.587413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:09:58.587413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:09:58.587413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:09:58.594223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:09:58.595035 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:09:58.595035 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:09:58.595035 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:09:58.595035 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 9/18] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:09:58.595035 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839e0b4-34e1-4cda-a024-1182c37cdd58 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:09:58.653817 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:09:58.681701 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace7a7f-6b76-4d47-b12f-f5409b1b93a7 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:09:58.720869 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c4cab-9a70-4da2-aeba-699561066ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:09:58.721549 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c4cab-9a70-4da2-aeba-699561066ac9 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:58.721829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c4cab-9a70-4da2-aeba-699561066ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:58.722100 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c4cab-9a70-4da2-aeba-699561066ac9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:58.723296 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c4cab-9a70-4da2-aeba-699561066ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:09:58.724796 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c4cab-9a70-4da2-aeba-699561066ac9 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:09:58.726626 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 10/19] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:09:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:09:58.738718 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c4cab-9a70-4da2-aeba-699561066ac9 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:09:58.809475 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839e0b4-34e1-4cda-a024-1182c37cdd58 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:09:58.830362 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:09:58.843487 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133e611-fe85-4df2-88be-7031643f5759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:09:58.845871 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e611-fe85-4df2-88be-7031643f5759 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:58.845871 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e611-fe85-4df2-88be-7031643f5759 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:58.845871 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e611-fe85-4df2-88be-7031643f5759 None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:58.845871 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133e611-fe85-4df2-88be-7031643f5759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:09:58.845871 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133e611-fe85-4df2-88be-7031643f5759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:09:58.847047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133e611-fe85-4df2-88be-7031643f5759 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:09:58.857025 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c4cab-9a70-4da2-aeba-699561066ac9 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:09:58.865095 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 10/20] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:09:58.895625 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd5507-20c8-488c-bbc8-cba476c413cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:09:58.896386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd5507-20c8-488c-bbc8-cba476c413cc None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:09:58.896742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd5507-20c8-488c-bbc8-cba476c413cc None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:09:58.897148 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd5507-20c8-488c-bbc8-cba476c413cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:09:58.897907 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd5507-20c8-488c-bbc8-cba476c413cc None admin] RBAC: Adding query filter params (role.id=fda5389edef24d6baac46d87242d285b, scope.domain.id=default, user.id=93e416b080ca43b493d7d04aa867adf6) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:09:58.898219 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd5507-20c8-488c-bbc8-cba476c413cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:09:58.899756 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd5507-20c8-488c-bbc8-cba476c413cc None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:09:58.908055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 11/21] 10.222.0.82 () {56 vars in 1322 bytes} [Fri Aug 19 01:09:58 2022] GET /identity/v3/role_assignments?user.id=93e416b080ca43b493d7d04aa867adf6&scope.domain.id=default&role.id=fda5389edef24d6baac46d87242d285b => generated 233 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:01.499328 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff163a0c-f1c3-4509-bc20-1aec359b5fab None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:01.499860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff163a0c-f1c3-4509-bc20-1aec359b5fab None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:01.499860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff163a0c-f1c3-4509-bc20-1aec359b5fab None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:01.501513 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 11/22] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:01.506366 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b84f75-5d50-4734-987c-10f7e44797dc None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:01.506778 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b84f75-5d50-4734-987c-10f7e44797dc None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:01.506941 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b84f75-5d50-4734-987c-10f7e44797dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:01.530177 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-20b84f75-5d50-4734-987c-10f7e44797dc None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:01.531395 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-20b84f75-5d50-4734-987c-10f7e44797dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:01.635765 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 12/23] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:01.962853 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a6c58-66d2-482c-973c-c7e7af29b78b None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:01.963328 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a6c58-66d2-482c-973c-c7e7af29b78b None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:01.963551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a6c58-66d2-482c-973c-c7e7af29b78b None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:01.965079 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 12/24] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:01.970700 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d506b-0f5a-4214-bf12-efda358492b7 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:01.978057 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d506b-0f5a-4214-bf12-efda358492b7 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:01.978057 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d506b-0f5a-4214-bf12-efda358492b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:01.993059 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-124d506b-0f5a-4214-bf12-efda358492b7 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:01.994779 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-124d506b-0f5a-4214-bf12-efda358492b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:02.058453 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a6c58-66d2-482c-973c-c7e7af29b78b None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:02.092525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 13/25] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:02.149621 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d61264-6d84-4052-98f1-935fbb8e0313 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:02.150264 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d61264-6d84-4052-98f1-935fbb8e0313 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:02.151415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d61264-6d84-4052-98f1-935fbb8e0313 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:02.152974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 14/26] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:10:02.159128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245c964-44a2-4fb4-8a43-128a8300787b None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:02.159664 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245c964-44a2-4fb4-8a43-128a8300787b None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:02.160247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245c964-44a2-4fb4-8a43-128a8300787b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:02.188899 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:02.198520 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-7245c964-44a2-4fb4-8a43-128a8300787b None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:02.203214 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-7245c964-44a2-4fb4-8a43-128a8300787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:02.280888 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a6c58-66d2-482c-973c-c7e7af29b78b None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:02.313218 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:02.353826 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a345d1-0017-4046-a4ab-3fdb1fa9bd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:02.354572 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a345d1-0017-4046-a4ab-3fdb1fa9bd65 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:02.354810 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a345d1-0017-4046-a4ab-3fdb1fa9bd65 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:02.355091 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a345d1-0017-4046-a4ab-3fdb1fa9bd65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:02.373925 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a345d1-0017-4046-a4ab-3fdb1fa9bd65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:02.375411 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a345d1-0017-4046-a4ab-3fdb1fa9bd65 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:02.388141 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 15/27] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:02.405809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-10a345d1-0017-4046-a4ab-3fdb1fa9bd65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:10:02.405809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:02.405809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:02.405809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:02.405809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:02.405809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:02.405809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:02.405809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:02.405809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:02.405809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:02.405809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:02.405809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:02.405809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:10:02.405809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:10:02.405809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:10:02.405809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:02.406688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:10:02.407468 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:10:02.407468 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:10:02.407468 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:02.407468 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 13/28] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:10:02.414196 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245c964-44a2-4fb4-8a43-128a8300787b None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:02.548639 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a345d1-0017-4046-a4ab-3fdb1fa9bd65 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:02.600059 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245c964-44a2-4fb4-8a43-128a8300787b None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:02.678654 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1f62d-347d-4d31-b8a8-f1006ad268f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:02.679708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1f62d-347d-4d31-b8a8-f1006ad268f8 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:02.680181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1f62d-347d-4d31-b8a8-f1006ad268f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:02.680641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1f62d-347d-4d31-b8a8-f1006ad268f8 None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:02.681646 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1f62d-347d-4d31-b8a8-f1006ad268f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:02.683124 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1f62d-347d-4d31-b8a8-f1006ad268f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:02.684802 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1f62d-347d-4d31-b8a8-f1006ad268f8 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:02.698715 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:02.712191 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 16/29] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:02.718329 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1f62d-347d-4d31-b8a8-f1006ad268f8 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:02.818153 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a345d1-0017-4046-a4ab-3fdb1fa9bd65 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:02.842636 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1f62d-347d-4d31-b8a8-f1006ad268f8 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:02.879866 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab5940-7d32-4311-b94f-18b12847f3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:02.880750 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab5940-7d32-4311-b94f-18b12847f3de None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:02.881225 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab5940-7d32-4311-b94f-18b12847f3de None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:02.881650 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab5940-7d32-4311-b94f-18b12847f3de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:02.889793 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49aec32-2d64-47f1-99aa-2a2eee1e24a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:02.890638 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49aec32-2d64-47f1-99aa-2a2eee1e24a0 None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:02.891058 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49aec32-2d64-47f1-99aa-2a2eee1e24a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:02.891489 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49aec32-2d64-47f1-99aa-2a2eee1e24a0 None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:02.892293 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49aec32-2d64-47f1-99aa-2a2eee1e24a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:02.893929 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49aec32-2d64-47f1-99aa-2a2eee1e24a0 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:02.894114 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab5940-7d32-4311-b94f-18b12847f3de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:02.901023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-5fab5940-7d32-4311-b94f-18b12847f3de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:02.901023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:02.901023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:02.901023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:02.901023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:02.901023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:02.901023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:02.901023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:02.901023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:02.901023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:02.901023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:02.901023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:02.901023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:02.901023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:02.901023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:02.901023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:02.902047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:02.902047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:02.902047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:02.902047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:02.902047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:02.902047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:02.902047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:02.902047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:02.902047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:02.902047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:02.902047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:02.902047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:02.902047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:02.902047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:02.902047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:02.902047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:02.902790 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:02.902790 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:02.902790 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:02.902790 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:02.902790 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:02.902790 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:02.902790 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:02.902790 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:02.902790 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:02.902790 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:02.902790 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:02.902790 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:02.902790 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 14/30] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:10:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:10:02.903423 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621c3b0-b42e-4814-aa57-336ad062757d None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:02.904246 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621c3b0-b42e-4814-aa57-336ad062757d None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:02.904246 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621c3b0-b42e-4814-aa57-336ad062757d None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:02.905393 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 15/31] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:02.907139 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e63e97-bc9d-480c-b26c-177aba3c287d None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:02.907139 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e63e97-bc9d-480c-b26c-177aba3c287d None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:02.907139 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e63e97-bc9d-480c-b26c-177aba3c287d None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:02.908028 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 16/32] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:02.912502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e63e97-bc9d-480c-b26c-177aba3c287d None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:02.941807 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:03.018189 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e63e97-bc9d-480c-b26c-177aba3c287d None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:03.054680 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5b6f7-d4e5-43c5-8840-035849289670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:03.055600 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5b6f7-d4e5-43c5-8840-035849289670 None admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:03.056053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5b6f7-d4e5-43c5-8840-035849289670 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:03.056494 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5b6f7-d4e5-43c5-8840-035849289670 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:03.057944 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5b6f7-d4e5-43c5-8840-035849289670 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:03.059620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5b6f7-d4e5-43c5-8840-035849289670 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:03.111553 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 17/33] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Aug 19 01:10:02 2022] POST /identity/v3/projects => generated 301 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:10:03.113031 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5576dee-cd5c-44d4-8b84-699b54a187e6 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:03.113329 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5576dee-cd5c-44d4-8b84-699b54a187e6 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:03.113611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5576dee-cd5c-44d4-8b84-699b54a187e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:03.136116 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-c5576dee-cd5c-44d4-8b84-699b54a187e6 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:03.137822 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-c5576dee-cd5c-44d4-8b84-699b54a187e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:03.194763 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:03.224731 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 18/34] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:03.226086 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c6bb8-bde5-4f4c-8943-bd9f03ebccb3 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:03.226378 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c6bb8-bde5-4f4c-8943-bd9f03ebccb3 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:03.226656 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c6bb8-bde5-4f4c-8943-bd9f03ebccb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:03.251183 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-e92c6bb8-bde5-4f4c-8943-bd9f03ebccb3 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:03.252540 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-e92c6bb8-bde5-4f4c-8943-bd9f03ebccb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:03.316898 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 17/35] 10.222.0.82 () {60 vars in 1131 bytes} [Fri Aug 19 01:10:02 2022] POST /identity/v3/roles => generated 219 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:10:03.316898 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5b6f7-d4e5-43c5-8840-035849289670 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:03.368638 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 19/36] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:03.456185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:03.469937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5b6f7-d4e5-43c5-8840-035849289670 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:03.506940 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf30576-beb4-44b9-af86-2d02b2a0e05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:03.508051 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf30576-beb4-44b9-af86-2d02b2a0e05d None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:03.508533 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf30576-beb4-44b9-af86-2d02b2a0e05d None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:03.509026 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf30576-beb4-44b9-af86-2d02b2a0e05d None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:03.510530 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf30576-beb4-44b9-af86-2d02b2a0e05d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:03.511254 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf30576-beb4-44b9-af86-2d02b2a0e05d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:03.513083 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf30576-beb4-44b9-af86-2d02b2a0e05d None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:03.528453 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 18/37] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:03.532795 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c6bb8-bde5-4f4c-8943-bd9f03ebccb3 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:03.539227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44be16-76a2-4cf2-9841-e0bb2212440d None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:03.544946 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44be16-76a2-4cf2-9841-e0bb2212440d None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:03.544946 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44be16-76a2-4cf2-9841-e0bb2212440d None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:03.544946 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 19/38] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:03.556306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2a154-0eb8-499c-9e60-d2faf27ee764 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:03.557369 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2a154-0eb8-499c-9e60-d2faf27ee764 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:03.557513 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2a154-0eb8-499c-9e60-d2faf27ee764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:03.582812 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-3ab2a154-0eb8-499c-9e60-d2faf27ee764 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:03.584778 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-3ab2a154-0eb8-499c-9e60-d2faf27ee764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:03.681426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 20/39] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:03.683644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2a154-0eb8-499c-9e60-d2faf27ee764 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:03.706416 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c6bb8-bde5-4f4c-8943-bd9f03ebccb3 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:03.718750 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:03.774461 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be82bcf-44e0-4d7e-a5c9-921db7a8e0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:03.775139 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be82bcf-44e0-4d7e-a5c9-921db7a8e0cb None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:03.775422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be82bcf-44e0-4d7e-a5c9-921db7a8e0cb None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:03.775888 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be82bcf-44e0-4d7e-a5c9-921db7a8e0cb None admin] PATH_INFO: `/v3/users/93e416b080ca43b493d7d04aa867adf6` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:03.777237 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be82bcf-44e0-4d7e-a5c9-921db7a8e0cb None admin] RBAC: Authorizing `identity:get_user(user_id=93e416b080ca43b493d7d04aa867adf6)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:03.778908 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be82bcf-44e0-4d7e-a5c9-921db7a8e0cb None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:03.780650 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 20/40] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:03 2022] GET /identity/v3/users/93e416b080ca43b493d7d04aa867adf6 => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:03.786247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be82bcf-44e0-4d7e-a5c9-921db7a8e0cb None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:03.811404 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:03.835480 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2a154-0eb8-499c-9e60-d2faf27ee764 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:03.874773 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000340ed-192a-4b2e-bcf5-a4041be478d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:03.875416 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000340ed-192a-4b2e-bcf5-a4041be478d7 None admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:03.875775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000340ed-192a-4b2e-bcf5-a4041be478d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:03.876052 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000340ed-192a-4b2e-bcf5-a4041be478d7 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:03.876786 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000340ed-192a-4b2e-bcf5-a4041be478d7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:03.878205 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000340ed-192a-4b2e-bcf5-a4041be478d7 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:03.907875 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be82bcf-44e0-4d7e-a5c9-921db7a8e0cb None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:03.935519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 21/41] 10.222.0.82 () {60 vars in 1131 bytes} [Fri Aug 19 01:10:03 2022] POST /identity/v3/roles => generated 223 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:10:03.936111 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000340ed-192a-4b2e-bcf5-a4041be478d7 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:03.951827 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe26c5-5438-4583-ab6c-f058fb1b2b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:03.953168 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe26c5-5438-4583-ab6c-f058fb1b2b5e None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:03.953651 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe26c5-5438-4583-ab6c-f058fb1b2b5e None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:03.954579 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe26c5-5438-4583-ab6c-f058fb1b2b5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:03.957236 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe26c5-5438-4583-ab6c-f058fb1b2b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:03.959800 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe26c5-5438-4583-ab6c-f058fb1b2b5e None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:03.969105 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 21/42] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:10:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:03.974738 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe26c5-5438-4583-ab6c-f058fb1b2b5e None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:04.036640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:04.086040 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000340ed-192a-4b2e-bcf5-a4041be478d7 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:04.105611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe26c5-5438-4583-ab6c-f058fb1b2b5e None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:04.126195 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4454e0-ab2a-4b99-8949-84018fde45e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:04.127126 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4454e0-ab2a-4b99-8949-84018fde45e7 None admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:04.127565 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4454e0-ab2a-4b99-8949-84018fde45e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:04.127841 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4454e0-ab2a-4b99-8949-84018fde45e7 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:04.128681 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4454e0-ab2a-4b99-8949-84018fde45e7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:04.129956 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4454e0-ab2a-4b99-8949-84018fde45e7 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:04.145501 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0f802-0e6b-47a3-8dcb-93e0bd6d142d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:04.146205 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f802-0e6b-47a3-8dcb-93e0bd6d142d None admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:04.146491 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f802-0e6b-47a3-8dcb-93e0bd6d142d None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:04.148999 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f802-0e6b-47a3-8dcb-93e0bd6d142d None admin] PATH_INFO: `/v3/domains/default/users/93e416b080ca43b493d7d04aa867adf6/roles/fda5389edef24d6baac46d87242d285b` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:04.148999 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0f802-0e6b-47a3-8dcb-93e0bd6d142d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=93e416b080ca43b493d7d04aa867adf6, role_id=fda5389edef24d6baac46d87242d285b)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:04.152634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0f802-0e6b-47a3-8dcb-93e0bd6d142d None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:04.198092 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:04.203169 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 22/43] 10.222.0.82 () {60 vars in 1131 bytes} [Fri Aug 19 01:10:03 2022] POST /identity/v3/roles => generated 225 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:10:04.204396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4454e0-ab2a-4b99-8949-84018fde45e7 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:04.265184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 22/44] 10.222.0.82 () {58 vars in 1361 bytes} [Fri Aug 19 01:10:03 2022] PUT /identity/v3/domains/default/users/93e416b080ca43b493d7d04aa867adf6/roles/fda5389edef24d6baac46d87242d285b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 01:10:04.322935 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4454e0-ab2a-4b99-8949-84018fde45e7 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:04.368825 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7722e6-6e48-4f71-936b-7ebf8ebafd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:04.369514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7722e6-6e48-4f71-936b-7ebf8ebafd5a None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:04.369821 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7722e6-6e48-4f71-936b-7ebf8ebafd5a None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:04.370092 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7722e6-6e48-4f71-936b-7ebf8ebafd5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:04.371633 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7722e6-6e48-4f71-936b-7ebf8ebafd5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:04.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7722e6-6e48-4f71-936b-7ebf8ebafd5a None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:04.375085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 23/45] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:10:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:04.380709 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0f802-0e6b-47a3-8dcb-93e0bd6d142d None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:04.504643 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0f802-0e6b-47a3-8dcb-93e0bd6d142d None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:04.506143 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:04.541776 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c6d79-aebc-410e-ac08-14af988ddfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:04.542323 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c6d79-aebc-410e-ac08-14af988ddfb6 None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:04.542605 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c6d79-aebc-410e-ac08-14af988ddfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:04.542878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c6d79-aebc-410e-ac08-14af988ddfb6 None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:04.543526 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c6d79-aebc-410e-ac08-14af988ddfb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:04.545146 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c6d79-aebc-410e-ac08-14af988ddfb6 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:04.608953 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 23/46] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Aug 19 01:10:04 2022] POST /identity/v3/projects => generated 312 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:10:06.447273 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8d704-4ca8-4ada-a06c-71610bdecf40 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:06.447888 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8d704-4ca8-4ada-a06c-71610bdecf40 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:06.447971 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8d704-4ca8-4ada-a06c-71610bdecf40 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:06.449378 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 24/47] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:06.454491 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd1711-9dfb-4397-85a3-f38c88432fcc None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:06.454893 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd1711-9dfb-4397-85a3-f38c88432fcc None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:06.455170 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd1711-9dfb-4397-85a3-f38c88432fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:06.473707 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-86bd1711-9dfb-4397-85a3-f38c88432fcc None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:06.474907 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-86bd1711-9dfb-4397-85a3-f38c88432fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:06.546100 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 24/48] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:06.834382 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2648e-ff76-4a15-a17b-f1e50c16687f None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:06.834644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2648e-ff76-4a15-a17b-f1e50c16687f None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:06.834867 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2648e-ff76-4a15-a17b-f1e50c16687f None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:06.836188 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 25/49] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:06.841532 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170b2dd-7ca2-4f89-9c2e-e07b07eee4ad None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:06.841828 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170b2dd-7ca2-4f89-9c2e-e07b07eee4ad None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:06.842107 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170b2dd-7ca2-4f89-9c2e-e07b07eee4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:06.860671 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-f170b2dd-7ca2-4f89-9c2e-e07b07eee4ad None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:06.861888 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-f170b2dd-7ca2-4f89-9c2e-e07b07eee4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:06.872511 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2648e-ff76-4a15-a17b-f1e50c16687f None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:06.930599 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 25/50] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:06.942251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:06.976081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2648e-ff76-4a15-a17b-f1e50c16687f None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:07.012647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2f618-daaa-4485-bebc-6729b844d6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:07.013321 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2f618-daaa-4485-bebc-6729b844d6cf None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:07.013601 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2f618-daaa-4485-bebc-6729b844d6cf None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:07.013873 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2f618-daaa-4485-bebc-6729b844d6cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:07.027035 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2f618-daaa-4485-bebc-6729b844d6cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:07.032227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-bda2f618-daaa-4485-bebc-6729b844d6cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:07.032227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:07.032227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:07.032227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:07.032227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:07.032227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:07.032227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:07.032227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:07.032227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:07.032227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:07.032227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:07.032227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:07.032227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:07.032227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:07.032227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:07.032227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:07.033118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:07.033118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:07.033118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:07.033118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:07.033118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:07.033118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:07.033118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:07.033118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:07.033118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:07.033118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:07.033118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:07.033118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:07.033118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:07.033118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:07.033118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:07.033118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:07.033862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:07.033862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:07.033862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:07.033862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:07.033862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:07.033862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:07.033862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:07.033862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:07.033862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:07.033862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:07.033862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:07.033862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:07.033862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 26/51] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:10:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:10:07.039208 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170b2dd-7ca2-4f89-9c2e-e07b07eee4ad None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:07.055626 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:07.140407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170b2dd-7ca2-4f89-9c2e-e07b07eee4ad None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:07.176470 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b1d10-b840-453a-8ac2-20686c6fb3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:07.177106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b1d10-b840-453a-8ac2-20686c6fb3d3 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:07.177441 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b1d10-b840-453a-8ac2-20686c6fb3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:07.177712 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b1d10-b840-453a-8ac2-20686c6fb3d3 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:07.178380 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b1d10-b840-453a-8ac2-20686c6fb3d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:07.184750 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b1d10-b840-453a-8ac2-20686c6fb3d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:07.184750 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b1d10-b840-453a-8ac2-20686c6fb3d3 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:07.188706 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 26/52] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:07.194429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2f618-daaa-4485-bebc-6729b844d6cf None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:07.267215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b1d10-b840-453a-8ac2-20686c6fb3d3 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:07.301219 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2f618-daaa-4485-bebc-6729b844d6cf None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:07.328171 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:07.335642 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45666db8-2de1-4a8e-89e9-ae9e9b102198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:07.336272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45666db8-2de1-4a8e-89e9-ae9e9b102198 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:07.336557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45666db8-2de1-4a8e-89e9-ae9e9b102198 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:07.336837 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45666db8-2de1-4a8e-89e9-ae9e9b102198 None admin] PATH_INFO: `/v3/users/93e416b080ca43b493d7d04aa867adf6` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:07.339266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45666db8-2de1-4a8e-89e9-ae9e9b102198 None admin] RBAC: Authorizing `identity:get_user(user_id=93e416b080ca43b493d7d04aa867adf6)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:07.340741 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45666db8-2de1-4a8e-89e9-ae9e9b102198 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:07.342352 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 27/53] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:07 2022] GET /identity/v3/users/93e416b080ca43b493d7d04aa867adf6 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:07.347685 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45666db8-2de1-4a8e-89e9-ae9e9b102198 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:07.349207 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:07.372033 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b1d10-b840-453a-8ac2-20686c6fb3d3 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:07.407552 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa1457-889e-4fb9-905e-90be910dae7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:07.408107 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa1457-889e-4fb9-905e-90be910dae7f None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:07.408384 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa1457-889e-4fb9-905e-90be910dae7f None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:07.408657 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa1457-889e-4fb9-905e-90be910dae7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:07.409793 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa1457-889e-4fb9-905e-90be910dae7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:07.411246 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa1457-889e-4fb9-905e-90be910dae7f None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:07.417145 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 27/54] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:10:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:07.418867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa1457-889e-4fb9-905e-90be910dae7f None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:07.452868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45666db8-2de1-4a8e-89e9-ae9e9b102198 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:07.486876 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90655d-cfc4-463b-8e65-338acd2c77fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:07.487513 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90655d-cfc4-463b-8e65-338acd2c77fc None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:07.487795 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90655d-cfc4-463b-8e65-338acd2c77fc None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:07.488073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90655d-cfc4-463b-8e65-338acd2c77fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:07.489230 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90655d-cfc4-463b-8e65-338acd2c77fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:07.490668 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90655d-cfc4-463b-8e65-338acd2c77fc None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:07.492212 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 28/55] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:10:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:07.498489 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90655d-cfc4-463b-8e65-338acd2c77fc None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:07.519344 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa1457-889e-4fb9-905e-90be910dae7f None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:07.555860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebb972-bdfa-4718-9fe7-8a64d8563d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:07.556479 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebb972-bdfa-4718-9fe7-8a64d8563d3b None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:07.556774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebb972-bdfa-4718-9fe7-8a64d8563d3b None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:07.557755 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebb972-bdfa-4718-9fe7-8a64d8563d3b None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:07.558407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebb972-bdfa-4718-9fe7-8a64d8563d3b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:07.559860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebb972-bdfa-4718-9fe7-8a64d8563d3b None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:07.563550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:07.576505 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:07.601353 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90655d-cfc4-463b-8e65-338acd2c77fc None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:07.635210 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408b0ff-cdfa-4243-b764-bc22de8cb7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:07.635861 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408b0ff-cdfa-4243-b764-bc22de8cb7cf None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:07.636144 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408b0ff-cdfa-4243-b764-bc22de8cb7cf None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:07.636413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408b0ff-cdfa-4243-b764-bc22de8cb7cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:07.637222 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408b0ff-cdfa-4243-b764-bc22de8cb7cf None admin] RBAC: Adding query filter params (role.id=fda5389edef24d6baac46d87242d285b, scope.domain.id=default, user.id=93e416b080ca43b493d7d04aa867adf6) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:07.637526 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408b0ff-cdfa-4243-b764-bc22de8cb7cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:07.639022 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408b0ff-cdfa-4243-b764-bc22de8cb7cf None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:07.647574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 29/56] 10.222.0.82 () {56 vars in 1322 bytes} [Fri Aug 19 01:10:07 2022] GET /identity/v3/role_assignments?user.id=93e416b080ca43b493d7d04aa867adf6&scope.domain.id=default&role.id=fda5389edef24d6baac46d87242d285b => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:07.665137 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 28/57] 10.222.0.82 () {60 vars in 1140 bytes} [Fri Aug 19 01:10:07 2022] POST /identity/v3/projects => generated 298 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:10:09.881077 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5181666-4f69-43f4-813c-479de3a6dca5 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:09.881610 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5181666-4f69-43f4-813c-479de3a6dca5 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:09.881610 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5181666-4f69-43f4-813c-479de3a6dca5 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:09.882960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 30/58] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:09.888684 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c20f64-2a54-4b5b-bd1b-4a3fa1bc7876 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:09.889086 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c20f64-2a54-4b5b-bd1b-4a3fa1bc7876 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:09.889295 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c20f64-2a54-4b5b-bd1b-4a3fa1bc7876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:09.908822 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-e4c20f64-2a54-4b5b-bd1b-4a3fa1bc7876 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:09.910126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-e4c20f64-2a54-4b5b-bd1b-4a3fa1bc7876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:09.980622 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 29/59] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:10.307376 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5181666-4f69-43f4-813c-479de3a6dca5 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:10.410294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5181666-4f69-43f4-813c-479de3a6dca5 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:10.436926 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:10.444285 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe18d0c-5fe7-4bdd-a571-20d3ec936e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:10.444945 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe18d0c-5fe7-4bdd-a571-20d3ec936e5b None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:10.445230 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe18d0c-5fe7-4bdd-a571-20d3ec936e5b None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:10.445505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe18d0c-5fe7-4bdd-a571-20d3ec936e5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:10.450236 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe18d0c-5fe7-4bdd-a571-20d3ec936e5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:10.450236 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe18d0c-5fe7-4bdd-a571-20d3ec936e5b None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:10.450236 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 31/60] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:10:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:10.455607 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c20f64-2a54-4b5b-bd1b-4a3fa1bc7876 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:10.554946 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c20f64-2a54-4b5b-bd1b-4a3fa1bc7876 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:10.581364 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:10.589629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c76538-93c0-410c-b5bc-b17500a6c565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:10.590241 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c76538-93c0-410c-b5bc-b17500a6c565 None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:10.593288 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c76538-93c0-410c-b5bc-b17500a6c565 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:10.593288 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c76538-93c0-410c-b5bc-b17500a6c565 None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:10.593288 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c76538-93c0-410c-b5bc-b17500a6c565 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:10.593288 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c76538-93c0-410c-b5bc-b17500a6c565 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:10.664583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 30/61] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Aug 19 01:10:10 2022] POST /identity/v3/users => generated 275 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:10:13.900065 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18312a1-5652-490b-a958-c9b22b02cf8f None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:13.900944 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18312a1-5652-490b-a958-c9b22b02cf8f None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:13.901365 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18312a1-5652-490b-a958-c9b22b02cf8f None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:13.903082 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 32/62] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:13.908516 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ff175-957b-44f9-a0b3-fdad909294d8 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:13.908976 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ff175-957b-44f9-a0b3-fdad909294d8 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:13.909153 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ff175-957b-44f9-a0b3-fdad909294d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:13.938974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-a22ff175-957b-44f9-a0b3-fdad909294d8 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:13.940418 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-a22ff175-957b-44f9-a0b3-fdad909294d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:14.027879 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 31/63] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:14.217902 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924290cc-2e9c-4911-aa8a-059bf40d22fe None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:14.218464 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924290cc-2e9c-4911-aa8a-059bf40d22fe None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:14.218744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924290cc-2e9c-4911-aa8a-059bf40d22fe None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:14.219678 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c209848-8c86-4331-bdd5-e6c5648fb819 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:14.220189 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c209848-8c86-4331-bdd5-e6c5648fb819 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:14.220307 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 33/64] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:14.221028 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c209848-8c86-4331-bdd5-e6c5648fb819 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:14.222569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 32/65] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:10:14.228904 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f769c-519c-4b29-bcd5-84d0c53e0883 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:14.229196 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f769c-519c-4b29-bcd5-84d0c53e0883 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:14.229476 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f769c-519c-4b29-bcd5-84d0c53e0883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:14.229707 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f3a7f-bdfa-433b-aad6-5de4de201bf3 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:14.230746 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f3a7f-bdfa-433b-aad6-5de4de201bf3 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:14.231228 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f3a7f-bdfa-433b-aad6-5de4de201bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:14.251543 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-9e9f3a7f-bdfa-433b-aad6-5de4de201bf3 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:14.253638 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-9e9f3a7f-bdfa-433b-aad6-5de4de201bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:14.264534 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-c36f769c-519c-4b29-bcd5-84d0c53e0883 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:14.266158 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-c36f769c-519c-4b29-bcd5-84d0c53e0883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:14.349794 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 33/66] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:14.399144 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 34/67] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:14.451254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f3a7f-bdfa-433b-aad6-5de4de201bf3 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:14.510986 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:14.580322 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f3a7f-bdfa-433b-aad6-5de4de201bf3 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:14.632373 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a44ed-3f9d-4018-85d2-ce4b6bdc097a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:14.633046 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a44ed-3f9d-4018-85d2-ce4b6bdc097a None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:14.633329 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a44ed-3f9d-4018-85d2-ce4b6bdc097a None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:14.633602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a44ed-3f9d-4018-85d2-ce4b6bdc097a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:14.647251 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a44ed-3f9d-4018-85d2-ce4b6bdc097a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:14.652634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-396a44ed-3f9d-4018-85d2-ce4b6bdc097a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:14.652634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:14.652634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:14.652634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:14.652634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:14.652634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:14.652634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:14.652634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:14.652634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:14.652634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:14.652634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:14.652634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:14.652634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:14.652634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:14.652634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:14.652634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:14.653743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:14.653743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:14.653743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:14.653743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:14.653743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:14.653743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:14.653743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:14.653743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:14.653743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:14.653743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:14.653743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:14.653743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:14.653743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:14.653743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:14.653743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:14.653743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:14.654878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:14.654878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:14.654878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:14.654878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:14.654878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:14.654878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:14.654878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:14.654878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:14.654878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:14.654878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:14.654878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:14.654878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:14.654878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 34/68] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:14.661969 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f769c-519c-4b29-bcd5-84d0c53e0883 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:14.780831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a44ed-3f9d-4018-85d2-ce4b6bdc097a None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:14.781959 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f769c-519c-4b29-bcd5-84d0c53e0883 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:14.812438 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:14.827735 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af9c26-586a-4315-bbbc-ff051f117307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:14.828359 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af9c26-586a-4315-bbbc-ff051f117307 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:14.828643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af9c26-586a-4315-bbbc-ff051f117307 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:14.828961 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af9c26-586a-4315-bbbc-ff051f117307 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:14.829645 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af9c26-586a-4315-bbbc-ff051f117307 None admin] RBAC: Adding query filter params (name=member) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:14.829953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af9c26-586a-4315-bbbc-ff051f117307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:14.831416 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af9c26-586a-4315-bbbc-ff051f117307 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:14.844722 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 35/69] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:14.846023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af9c26-586a-4315-bbbc-ff051f117307 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:14.920459 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a44ed-3f9d-4018-85d2-ce4b6bdc097a None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:14.922620 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:14.958404 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a23334-f3a4-420b-8017-759d8be04c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:14.959047 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a23334-f3a4-420b-8017-759d8be04c74 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:14.959333 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a23334-f3a4-420b-8017-759d8be04c74 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:14.959608 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a23334-f3a4-420b-8017-759d8be04c74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:14.971412 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a23334-f3a4-420b-8017-759d8be04c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:14.975992 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af9c26-586a-4315-bbbc-ff051f117307 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:14.976473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-72a23334-f3a4-420b-8017-759d8be04c74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:10:14.976473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:14.976473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:14.976473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:14.976473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:14.976473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:14.976473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:14.976473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:14.976473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:14.976473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:14.976473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:14.976473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:14.976473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:14.976473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:14.976473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:14.976473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:14.977361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:14.977361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:14.977361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:14.977361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:14.977361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:14.977361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:14.977361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:14.977361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:14.977361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:14.977361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:14.977361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:14.977361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:14.977361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:14.977361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:14.977361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:14.977361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:14.978108 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:14.978108 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:14.978108 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:14.978108 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:14.978108 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:14.978108 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:14.978108 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:14.978108 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:14.978108 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:14.978108 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:14.978108 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:10:14.978108 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:14.978108 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 35/70] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:10:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:14.978718 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a23334-f3a4-420b-8017-759d8be04c74 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:15.019384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca1802-3b0e-4fc8-96bc-799f205cfedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:15.020295 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca1802-3b0e-4fc8-96bc-799f205cfedd None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:15.020578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca1802-3b0e-4fc8-96bc-799f205cfedd None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:15.020866 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca1802-3b0e-4fc8-96bc-799f205cfedd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:15.032146 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca1802-3b0e-4fc8-96bc-799f205cfedd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:15.039559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-55ca1802-3b0e-4fc8-96bc-799f205cfedd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:15.039559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:15.039559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:15.039559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:15.039559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:15.039559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:15.039559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:15.039559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:15.039559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:15.039559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:15.039559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:15.039559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:15.039559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:15.039559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:15.039559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:15.039559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:15.040500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:15.040500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:15.040500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:15.040500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:15.040500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:15.040500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:15.040500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:15.040500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:15.040500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:15.040500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:15.040500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:15.040500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:15.040500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:15.040500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:15.040500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:15.040500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:15.041462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:15.041462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:15.041462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:15.041462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:15.041462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:15.041462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:15.041462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:15.041462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:15.041462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:15.041462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:15.041462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:15.041462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:15.041462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 36/71] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:10:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:15.044093 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847dd41-2d3f-47dc-ae20-97b1723d1d66 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:15.044379 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847dd41-2d3f-47dc-ae20-97b1723d1d66 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:15.044712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847dd41-2d3f-47dc-ae20-97b1723d1d66 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:15.046091 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 37/72] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:15.050657 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847dd41-2d3f-47dc-ae20-97b1723d1d66 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:15.084986 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a23334-f3a4-420b-8017-759d8be04c74 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:15.101336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:15.118658 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a01f6-0b3a-4642-8883-b05b73965508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:15.119289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a01f6-0b3a-4642-8883-b05b73965508 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:15.119571 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a01f6-0b3a-4642-8883-b05b73965508 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:15.119847 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a01f6-0b3a-4642-8883-b05b73965508 None admin] PATH_INFO: `/v3/users/6d0e2c6f0e0343118653a302efb265d8` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:15.134415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a01f6-0b3a-4642-8883-b05b73965508 None admin] RBAC: Authorizing `identity:get_user(user_id=6d0e2c6f0e0343118653a302efb265d8)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:15.136074 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a01f6-0b3a-4642-8883-b05b73965508 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:15.138265 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 36/73] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:14 2022] GET /identity/v3/users/6d0e2c6f0e0343118653a302efb265d8 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:15.139435 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af173b-84da-42f4-a40a-e0595883d3a5 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:15.139724 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af173b-84da-42f4-a40a-e0595883d3a5 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:15.139995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af173b-84da-42f4-a40a-e0595883d3a5 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:15.141400 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 37/74] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:15.145746 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af173b-84da-42f4-a40a-e0595883d3a5 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:15.153984 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847dd41-2d3f-47dc-ae20-97b1723d1d66 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:15.168077 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:15.188123 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6578bae-68d1-4b85-95fc-7d4d1b12c52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:15.188737 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6578bae-68d1-4b85-95fc-7d4d1b12c52c None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:15.189052 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6578bae-68d1-4b85-95fc-7d4d1b12c52c None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:15.189330 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6578bae-68d1-4b85-95fc-7d4d1b12c52c None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:15.189988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6578bae-68d1-4b85-95fc-7d4d1b12c52c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:15.190291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6578bae-68d1-4b85-95fc-7d4d1b12c52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:15.191681 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6578bae-68d1-4b85-95fc-7d4d1b12c52c None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:15.202683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 38/75] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:10:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:15.203877 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3d9cb-ce15-4f95-b457-c47acdfad00c None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:15.204184 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3d9cb-ce15-4f95-b457-c47acdfad00c None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:15.204465 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3d9cb-ce15-4f95-b457-c47acdfad00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:15.221997 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-18f3d9cb-ce15-4f95-b457-c47acdfad00c None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:15.223190 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-18f3d9cb-ce15-4f95-b457-c47acdfad00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:15.250616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af173b-84da-42f4-a40a-e0595883d3a5 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:15.284232 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc39c5-8656-444f-9a5f-1afbf8f2d050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:15.284768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc39c5-8656-444f-9a5f-1afbf8f2d050 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:15.285080 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc39c5-8656-444f-9a5f-1afbf8f2d050 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:15.285355 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc39c5-8656-444f-9a5f-1afbf8f2d050 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:15.286018 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc39c5-8656-444f-9a5f-1afbf8f2d050 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:15.286321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc39c5-8656-444f-9a5f-1afbf8f2d050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:15.287718 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc39c5-8656-444f-9a5f-1afbf8f2d050 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:15.289532 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 39/76] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:15.290364 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3d9cb-ce15-4f95-b457-c47acdfad00c None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:15.300194 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 38/77] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:15.301350 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b3043-56f9-485c-9ce6-f04c7bae804d None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:15.301638 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b3043-56f9-485c-9ce6-f04c7bae804d None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:15.301914 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b3043-56f9-485c-9ce6-f04c7bae804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:15.320060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-565b3043-56f9-485c-9ce6-f04c7bae804d None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:15.321291 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-565b3043-56f9-485c-9ce6-f04c7bae804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:15.337790 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:15.392751 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 39/78] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:15.393910 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b3043-56f9-485c-9ce6-f04c7bae804d None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:15.408687 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3d9cb-ce15-4f95-b457-c47acdfad00c None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:15.416457 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:15.446980 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ced891-8047-470d-9cdc-0726bc042d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:15.447840 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ced891-8047-470d-9cdc-0726bc042d32 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:15.448399 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ced891-8047-470d-9cdc-0726bc042d32 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:15.449006 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ced891-8047-470d-9cdc-0726bc042d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:15.528282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b3043-56f9-485c-9ce6-f04c7bae804d None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:15.532654 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ced891-8047-470d-9cdc-0726bc042d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:15.534495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ced891-8047-470d-9cdc-0726bc042d32 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:15.576569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242381c-1a8b-4b42-abb9-141bf7f7063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:15.577334 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242381c-1a8b-4b42-abb9-141bf7f7063f None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:15.577697 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242381c-1a8b-4b42-abb9-141bf7f7063f None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:15.578026 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242381c-1a8b-4b42-abb9-141bf7f7063f None admin] PATH_INFO: `/v3/users/6d0e2c6f0e0343118653a302efb265d8` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:15.579313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242381c-1a8b-4b42-abb9-141bf7f7063f None admin] RBAC: Authorizing `identity:get_user(user_id=6d0e2c6f0e0343118653a302efb265d8)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:15.580918 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242381c-1a8b-4b42-abb9-141bf7f7063f None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:15.581491 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:15.583824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 40/79] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:15 2022] GET /identity/v3/users/6d0e2c6f0e0343118653a302efb265d8 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:15.584793 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242381c-1a8b-4b42-abb9-141bf7f7063f None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:15.645904 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 40/80] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:15.645904 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ced891-8047-470d-9cdc-0726bc042d32 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:15.676824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:15.700836 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242381c-1a8b-4b42-abb9-141bf7f7063f None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:15.738995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429cf5c-a811-46d5-9d10-5044ab4aa5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:15.739828 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429cf5c-a811-46d5-9d10-5044ab4aa5cd None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:15.740212 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429cf5c-a811-46d5-9d10-5044ab4aa5cd None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:15.740579 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429cf5c-a811-46d5-9d10-5044ab4aa5cd None admin] PATH_INFO: `/v3/users/93e416b080ca43b493d7d04aa867adf6` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:15.741822 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429cf5c-a811-46d5-9d10-5044ab4aa5cd None admin] RBAC: Authorizing `identity:get_user(user_id=93e416b080ca43b493d7d04aa867adf6)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:15.743432 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429cf5c-a811-46d5-9d10-5044ab4aa5cd None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:15.745312 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 41/81] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:15 2022] GET /identity/v3/users/93e416b080ca43b493d7d04aa867adf6 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:15.750570 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429cf5c-a811-46d5-9d10-5044ab4aa5cd None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:15.752187 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ced891-8047-470d-9cdc-0726bc042d32 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:15.789493 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03816fc9-acfb-4f43-93e2-687cf0704478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:15.790018 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03816fc9-acfb-4f43-93e2-687cf0704478 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:15.790299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03816fc9-acfb-4f43-93e2-687cf0704478 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:15.790573 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03816fc9-acfb-4f43-93e2-687cf0704478 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:15.800935 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:15.852361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429cf5c-a811-46d5-9d10-5044ab4aa5cd None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:15.858947 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03816fc9-acfb-4f43-93e2-687cf0704478 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:15.860437 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03816fc9-acfb-4f43-93e2-687cf0704478 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:15.886702 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e3d26-158c-4980-ad39-716b0c4b7fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:15.887350 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e3d26-158c-4980-ad39-716b0c4b7fe7 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:15.887627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e3d26-158c-4980-ad39-716b0c4b7fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:15.887896 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e3d26-158c-4980-ad39-716b0c4b7fe7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:15.889033 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e3d26-158c-4980-ad39-716b0c4b7fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:15.891612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e3d26-158c-4980-ad39-716b0c4b7fe7 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:15.894454 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 42/82] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:10:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:15.895794 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e3d26-158c-4980-ad39-716b0c4b7fe7 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:15.913792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:15.961593 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 41/83] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:15.962420 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03816fc9-acfb-4f43-93e2-687cf0704478 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:15.997805 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e3d26-158c-4980-ad39-716b0c4b7fe7 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:16.006464 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:16.033608 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0608bb-e91e-4ada-882c-aeec526d23f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:16.034235 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0608bb-e91e-4ada-882c-aeec526d23f6 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:16.034512 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0608bb-e91e-4ada-882c-aeec526d23f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:16.034790 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0608bb-e91e-4ada-882c-aeec526d23f6 None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:16.035966 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0608bb-e91e-4ada-882c-aeec526d23f6 None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:16.037458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0608bb-e91e-4ada-882c-aeec526d23f6 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:16.039267 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 43/84] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:15 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:16.040089 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0608bb-e91e-4ada-882c-aeec526d23f6 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:16.067945 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03816fc9-acfb-4f43-93e2-687cf0704478 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:16.102522 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8cda9-7917-4e0b-b000-2225cf303161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:16.103132 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8cda9-7917-4e0b-b000-2225cf303161 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:16.103415 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8cda9-7917-4e0b-b000-2225cf303161 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:16.103690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8cda9-7917-4e0b-b000-2225cf303161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:16.125160 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:16.141075 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0608bb-e91e-4ada-882c-aeec526d23f6 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:16.172570 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8cda9-7917-4e0b-b000-2225cf303161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:16.174089 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8cda9-7917-4e0b-b000-2225cf303161 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:16.178494 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5fd4b-e552-44c0-a427-069fe9630f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:16.179127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5fd4b-e552-44c0-a427-069fe9630f83 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:16.179416 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5fd4b-e552-44c0-a427-069fe9630f83 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:16.179691 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5fd4b-e552-44c0-a427-069fe9630f83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:16.189889 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5fd4b-e552-44c0-a427-069fe9630f83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:16.194726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-97c5fd4b-e552-44c0-a427-069fe9630f83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:16.194726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:16.194726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:16.194726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:16.194726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:16.194726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:16.194726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:16.194726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:16.194726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:16.194726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:16.194726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:16.194726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:16.194726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:16.194726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:16.194726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:16.194726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:16.195580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:16.195580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:16.195580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:16.195580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:16.195580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:16.195580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:16.195580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:16.195580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:16.195580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:16.195580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:16.195580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:16.195580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:16.195580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:16.195580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:16.195580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:16.195580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:16.201325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:16.201325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:16.201325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:16.201325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:16.201325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:16.201325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:16.201325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:16.201325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:16.201325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:16.201325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:16.201325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:16.201325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:16.201325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 44/85] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:16.201325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5fd4b-e552-44c0-a427-069fe9630f83 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:16.216490 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:16.274338 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 42/86] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:16.274338 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8cda9-7917-4e0b-b000-2225cf303161 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:16.300907 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5fd4b-e552-44c0-a427-069fe9630f83 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:16.334434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d5fb4-0606-4cd9-b6a4-bdd3bb42fe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:16.335046 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d5fb4-0606-4cd9-b6a4-bdd3bb42fe1f None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:16.335330 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d5fb4-0606-4cd9-b6a4-bdd3bb42fe1f None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:16.335635 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d5fb4-0606-4cd9-b6a4-bdd3bb42fe1f None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:16.336279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d5fb4-0606-4cd9-b6a4-bdd3bb42fe1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:16.337763 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d5fb4-0606-4cd9-b6a4-bdd3bb42fe1f None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:16.376197 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8cda9-7917-4e0b-b000-2225cf303161 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:16.412777 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a092a-2934-4534-a143-4b9baaf605dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:16.413440 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a092a-2934-4534-a143-4b9baaf605dd None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:16.413723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a092a-2934-4534-a143-4b9baaf605dd None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:16.413996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a092a-2934-4534-a143-4b9baaf605dd None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:16.415129 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a092a-2934-4534-a143-4b9baaf605dd None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:16.415538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:16.416598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a092a-2934-4534-a143-4b9baaf605dd None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:16.418471 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 43/87] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:16 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:16.424378 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a092a-2934-4534-a143-4b9baaf605dd None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:16.424503 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 45/88] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Aug 19 01:10:16 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:10:16.430901 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:16.434284 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d5fb4-0606-4cd9-b6a4-bdd3bb42fe1f None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:16.541920 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a092a-2934-4534-a143-4b9baaf605dd None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:16.557713 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d5fb4-0606-4cd9-b6a4-bdd3bb42fe1f None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:16.588419 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c86e3-15ec-44a8-8798-f9f652e744d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:16.590336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c86e3-15ec-44a8-8798-f9f652e744d2 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:16.591008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c86e3-15ec-44a8-8798-f9f652e744d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:16.591292 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c86e3-15ec-44a8-8798-f9f652e744d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:16.592031 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c86e3-15ec-44a8-8798-f9f652e744d2 None admin] RBAC: Adding query filter params (role.id=f8c07e35d799437cbb53316acc2fc030, scope.project.id=926d0bea317c4b8a9c79dcb750be0c31, user.id=6d0e2c6f0e0343118653a302efb265d8) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:16.592341 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c86e3-15ec-44a8-8798-f9f652e744d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:16.594078 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c86e3-15ec-44a8-8798-f9f652e744d2 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:16.598439 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a0ed6-b347-4b81-a27b-e4566dd8cb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:16.599068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a0ed6-b347-4b81-a27b-e4566dd8cb46 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:16.599355 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a0ed6-b347-4b81-a27b-e4566dd8cb46 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:16.599627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a0ed6-b347-4b81-a27b-e4566dd8cb46 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:16.600301 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a0ed6-b347-4b81-a27b-e4566dd8cb46 None admin] RBAC: Adding query filter params (name=member) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:16.601252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a0ed6-b347-4b81-a27b-e4566dd8cb46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:16.601680 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 44/89] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:16 2022] GET /identity/v3/role_assignments?user.id=6d0e2c6f0e0343118653a302efb265d8&scope.project.id=926d0bea317c4b8a9c79dcb750be0c31&role.id=f8c07e35d799437cbb53316acc2fc030 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:16.608979 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a0ed6-b347-4b81-a27b-e4566dd8cb46 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:16.609169 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c86e3-15ec-44a8-8798-f9f652e744d2 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:16.618785 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 46/90] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:16.619688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a0ed6-b347-4b81-a27b-e4566dd8cb46 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:16.709247 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:16.717763 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:16.754391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c86e3-15ec-44a8-8798-f9f652e744d2 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:16.778713 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a0ed6-b347-4b81-a27b-e4566dd8cb46 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:16.812093 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba6b8e-201e-46de-b9d1-237febec897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:16.812671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba6b8e-201e-46de-b9d1-237febec897a None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:16.813015 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba6b8e-201e-46de-b9d1-237febec897a None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:16.813288 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba6b8e-201e-46de-b9d1-237febec897a None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:16.815755 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba6b8e-201e-46de-b9d1-237febec897a None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:16.817262 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba6b8e-201e-46de-b9d1-237febec897a None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:16.819058 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 45/91] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:16 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:16.819840 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba6b8e-201e-46de-b9d1-237febec897a None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:16.828144 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a593a-14c0-4f96-8a20-2fdff49b90dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:16.828764 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a593a-14c0-4f96-8a20-2fdff49b90dc None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:16.829190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a593a-14c0-4f96-8a20-2fdff49b90dc None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:16.829469 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a593a-14c0-4f96-8a20-2fdff49b90dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:16.830210 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a593a-14c0-4f96-8a20-2fdff49b90dc None admin] RBAC: Adding query filter params (role.id=63d0d2b4616248b3aa738ec590e2e4b3, scope.project.id=926d0bea317c4b8a9c79dcb750be0c31, user.id=6d0e2c6f0e0343118653a302efb265d8) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:16.830521 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a593a-14c0-4f96-8a20-2fdff49b90dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:16.831980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a593a-14c0-4f96-8a20-2fdff49b90dc None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:16.840076 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 47/92] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:16 2022] GET /identity/v3/role_assignments?user.id=6d0e2c6f0e0343118653a302efb265d8&scope.project.id=926d0bea317c4b8a9c79dcb750be0c31&role.id=63d0d2b4616248b3aa738ec590e2e4b3 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:16.841339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a593a-14c0-4f96-8a20-2fdff49b90dc None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:16.994843 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba6b8e-201e-46de-b9d1-237febec897a None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:17.045096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afbe28-6817-40db-89ea-c41ff9265498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:17.045878 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afbe28-6817-40db-89ea-c41ff9265498 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:17.046161 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afbe28-6817-40db-89ea-c41ff9265498 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:17.046889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afbe28-6817-40db-89ea-c41ff9265498 None admin] PATH_INFO: `/v3/users/6d0e2c6f0e0343118653a302efb265d8` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:17.048640 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afbe28-6817-40db-89ea-c41ff9265498 None admin] RBAC: Authorizing `identity:get_user(user_id=6d0e2c6f0e0343118653a302efb265d8)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:17.050156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afbe28-6817-40db-89ea-c41ff9265498 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:17.053465 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 46/93] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:16 2022] GET /identity/v3/users/6d0e2c6f0e0343118653a302efb265d8 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:17.058928 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afbe28-6817-40db-89ea-c41ff9265498 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:17.076359 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:17.099876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a593a-14c0-4f96-8a20-2fdff49b90dc None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:17.149665 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:17.170377 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820405d-2eb1-41f5-bf45-05792d635b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:17.171122 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820405d-2eb1-41f5-bf45-05792d635b75 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:17.171412 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820405d-2eb1-41f5-bf45-05792d635b75 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:17.171692 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820405d-2eb1-41f5-bf45-05792d635b75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:17.172472 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820405d-2eb1-41f5-bf45-05792d635b75 None admin] RBAC: Adding query filter params (role.id=fda5389edef24d6baac46d87242d285b, scope.project.id=926d0bea317c4b8a9c79dcb750be0c31, user.id=93e416b080ca43b493d7d04aa867adf6) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:17.172783 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820405d-2eb1-41f5-bf45-05792d635b75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:17.174603 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820405d-2eb1-41f5-bf45-05792d635b75 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:17.183680 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afbe28-6817-40db-89ea-c41ff9265498 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:17.187241 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 48/94] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:16 2022] GET /identity/v3/role_assignments?user.id=93e416b080ca43b493d7d04aa867adf6&scope.project.id=926d0bea317c4b8a9c79dcb750be0c31&role.id=fda5389edef24d6baac46d87242d285b => generated 259 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:17.224359 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126a5bf-fcd4-4187-889c-772148aadb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:17.225245 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126a5bf-fcd4-4187-889c-772148aadb6a None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:17.225764 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126a5bf-fcd4-4187-889c-772148aadb6a None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:17.226230 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126a5bf-fcd4-4187-889c-772148aadb6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:17.315641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126a5bf-fcd4-4187-889c-772148aadb6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:17.317153 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126a5bf-fcd4-4187-889c-772148aadb6a None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:17.331690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:17.465105 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 47/95] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:17.470647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820405d-2eb1-41f5-bf45-05792d635b75 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:17.617506 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820405d-2eb1-41f5-bf45-05792d635b75 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:17.670631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bccc06-94e4-49c5-ba74-30c22b09974f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:17.671279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bccc06-94e4-49c5-ba74-30c22b09974f None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:17.671562 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bccc06-94e4-49c5-ba74-30c22b09974f None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:17.671834 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bccc06-94e4-49c5-ba74-30c22b09974f None admin] PATH_INFO: `/v3/projects/4091c6ec4bc7465eaf8401cfae0300da` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:17.673018 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bccc06-94e4-49c5-ba74-30c22b09974f None admin] RBAC: Authorizing `identity:get_project(project_id=4091c6ec4bc7465eaf8401cfae0300da)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:17.674492 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bccc06-94e4-49c5-ba74-30c22b09974f None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:17.676408 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 49/96] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:17 2022] GET /identity/v3/projects/4091c6ec4bc7465eaf8401cfae0300da => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:17.682187 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126a5bf-fcd4-4187-889c-772148aadb6a None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:17.806010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126a5bf-fcd4-4187-889c-772148aadb6a None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:17.816291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:17.841566 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04ef96-3253-4ae0-be4d-98a7eec4a867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:17.842266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04ef96-3253-4ae0-be4d-98a7eec4a867 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:17.842618 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04ef96-3253-4ae0-be4d-98a7eec4a867 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:17.842960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04ef96-3253-4ae0-be4d-98a7eec4a867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:17.843747 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04ef96-3253-4ae0-be4d-98a7eec4a867 None admin] RBAC: Adding query filter params (role.id=f8c07e35d799437cbb53316acc2fc030, scope.project.id=4091c6ec4bc7465eaf8401cfae0300da, user.id=6d0e2c6f0e0343118653a302efb265d8) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:17.844123 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04ef96-3253-4ae0-be4d-98a7eec4a867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:17.845789 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04ef96-3253-4ae0-be4d-98a7eec4a867 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:17.856262 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 48/97] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:17 2022] GET /identity/v3/role_assignments?user.id=6d0e2c6f0e0343118653a302efb265d8&scope.project.id=4091c6ec4bc7465eaf8401cfae0300da&role.id=f8c07e35d799437cbb53316acc2fc030 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:19.721170 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae38867-3d6b-496a-91bf-0b210b7ec23a None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:19.721667 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae38867-3d6b-496a-91bf-0b210b7ec23a None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:19.721771 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae38867-3d6b-496a-91bf-0b210b7ec23a None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:19.723057 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 50/98] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:19.728495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b254aa-8387-486d-bcff-f1a742309cad None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:19.728929 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b254aa-8387-486d-bcff-f1a742309cad None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:19.729102 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b254aa-8387-486d-bcff-f1a742309cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:19.758400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-16b254aa-8387-486d-bcff-f1a742309cad None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:19.759604 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-16b254aa-8387-486d-bcff-f1a742309cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:19.773787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f04278-0b84-423e-9669-d43e53f9f546 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:19.774118 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f04278-0b84-423e-9669-d43e53f9f546 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:19.774349 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f04278-0b84-423e-9669-d43e53f9f546 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:19.775687 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 51/99] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:19.781379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f218e-e210-4988-901b-c1894a391e9f None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:19.781664 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f218e-e210-4988-901b-c1894a391e9f None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:19.781940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f218e-e210-4988-901b-c1894a391e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:19.809990 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-4b4f218e-e210-4988-901b-c1894a391e9f None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:19.811174 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-4b4f218e-e210-4988-901b-c1894a391e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:19.875370 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 49/100] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:19.895912 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89982082-8fb7-4534-9580-91557691e8a0 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:19.896229 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89982082-8fb7-4534-9580-91557691e8a0 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:19.896476 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89982082-8fb7-4534-9580-91557691e8a0 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:19.897852 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 50/101] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:10:19.907609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17eb350-dfdf-43c8-99d2-d87c2392fbc7 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:19.907896 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17eb350-dfdf-43c8-99d2-d87c2392fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:19.908178 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17eb350-dfdf-43c8-99d2-d87c2392fbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:19.920515 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:19.934741 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 52/102] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:19.950380 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-d17eb350-dfdf-43c8-99d2-d87c2392fbc7 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:19.951604 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-d17eb350-dfdf-43c8-99d2-d87c2392fbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:20.062318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 51/103] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:20.392464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f218e-e210-4988-901b-c1894a391e9f None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:20.535748 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f218e-e210-4988-901b-c1894a391e9f None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:20.594957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938e6d9-5204-4bec-b509-630c6d731a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:20.595602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938e6d9-5204-4bec-b509-630c6d731a63 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:20.595884 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938e6d9-5204-4bec-b509-630c6d731a63 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:20.596157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938e6d9-5204-4bec-b509-630c6d731a63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:20.612798 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938e6d9-5204-4bec-b509-630c6d731a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:20.613943 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17eb350-dfdf-43c8-99d2-d87c2392fbc7 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:20.617629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-4938e6d9-5204-4bec-b509-630c6d731a63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:20.617629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:20.617629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:20.617629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:20.617629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:20.617629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:20.617629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:20.617629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:20.617629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:20.617629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:20.617629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:20.617629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:20.617629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:20.617629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:20.617629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:20.617629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:20.618463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:20.618463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:20.618463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:20.618463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:20.618463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:20.618463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:20.618463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:20.618463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:20.618463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:20.618463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:20.618463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:20.618463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:20.618463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:20.618463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:20.618463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:20.618463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:20.619215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:20.619215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:20.619215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:20.619215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:20.619215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:20.619215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:20.619215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:20.619215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:20.619215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:20.619215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:20.619215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:20.619215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:20.619215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 53/104] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:20.625567 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db0c19-a1b3-43cc-8eed-fc2217dba938 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:20.625865 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db0c19-a1b3-43cc-8eed-fc2217dba938 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:20.626148 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db0c19-a1b3-43cc-8eed-fc2217dba938 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:20.627783 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 54/105] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:20.628505 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db0c19-a1b3-43cc-8eed-fc2217dba938 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:20.666915 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:20.705674 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:20.743170 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17eb350-dfdf-43c8-99d2-d87c2392fbc7 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:20.769262 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db0c19-a1b3-43cc-8eed-fc2217dba938 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:20.780302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719445f-42b2-4e7e-a1e2-f69bb37274a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:20.780977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719445f-42b2-4e7e-a1e2-f69bb37274a5 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:20.781263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719445f-42b2-4e7e-a1e2-f69bb37274a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:20.781536 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719445f-42b2-4e7e-a1e2-f69bb37274a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:20.794215 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719445f-42b2-4e7e-a1e2-f69bb37274a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:20.799405 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-8719445f-42b2-4e7e-a1e2-f69bb37274a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:10:20.799405 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:20.799405 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:20.799405 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:20.799405 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:20.799405 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:20.799405 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:20.799405 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:20.799405 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:20.799405 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:20.799405 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:20.799405 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:20.799405 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:20.799405 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:20.799405 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:20.799405 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:20.800294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:20.800294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:20.800294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:20.800294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:20.800294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:20.800294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:20.800294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:20.800294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:20.800294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:20.800294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:20.800294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:20.800294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:20.800294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:20.800294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:20.800294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:20.800294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:20.801147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:20.801147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:20.801147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:20.801147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:20.801147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:20.801147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:20.801147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:20.801147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:20.801147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:20.801147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:20.801147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:10:20.801147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:20.801147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 52/106] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:10:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:20.802484 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5310c-0866-4418-a727-eb931ae48c7d None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:20.802484 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5310c-0866-4418-a727-eb931ae48c7d None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:20.802484 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5310c-0866-4418-a727-eb931ae48c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:20.812762 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28d7ca-c42e-43e3-884d-5738bdff2a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:20.813493 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28d7ca-c42e-43e3-884d-5738bdff2a4b None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:20.813778 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28d7ca-c42e-43e3-884d-5738bdff2a4b None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:20.814053 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28d7ca-c42e-43e3-884d-5738bdff2a4b None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:20.814726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28d7ca-c42e-43e3-884d-5738bdff2a4b None admin] RBAC: Adding query filter params (name=member) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:20.815032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28d7ca-c42e-43e3-884d-5738bdff2a4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:20.816889 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28d7ca-c42e-43e3-884d-5738bdff2a4b None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:20.821132 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-f9a5310c-0866-4418-a727-eb931ae48c7d None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:20.822330 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-f9a5310c-0866-4418-a727-eb931ae48c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:20.826496 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 55/107] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:20.827656 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28d7ca-c42e-43e3-884d-5738bdff2a4b None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:20.896151 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 53/108] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:20.897502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb03e87-e2fd-4a5e-8343-73d5f6e86e3b None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:20.897791 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb03e87-e2fd-4a5e-8343-73d5f6e86e3b None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:20.898115 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb03e87-e2fd-4a5e-8343-73d5f6e86e3b None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:20.899571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 54/109] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:20.900094 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb03e87-e2fd-4a5e-8343-73d5f6e86e3b None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:20.931556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:20.955311 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28d7ca-c42e-43e3-884d-5738bdff2a4b None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:20.967331 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:20.991957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8fbfa-93a5-4636-a439-e91999ee1b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:20.992819 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8fbfa-93a5-4636-a439-e91999ee1b56 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:20.993327 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8fbfa-93a5-4636-a439-e91999ee1b56 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:20.993770 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8fbfa-93a5-4636-a439-e91999ee1b56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:21.005906 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8fbfa-93a5-4636-a439-e91999ee1b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:21.011768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-a9d8fbfa-93a5-4636-a439-e91999ee1b56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:21.011768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:21.011768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:21.011768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:21.011768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:21.011768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:21.011768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:21.011768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:21.011768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:21.011768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:21.011768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:21.011768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:21.011768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:21.011768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:21.011768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:21.011768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:21.013007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:21.013007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:21.013007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:21.013007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:21.013007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:21.013007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:21.013007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:21.013007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:21.013007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:21.013007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:21.013007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:21.013007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:21.013007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:21.013007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:21.013007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:21.013007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:21.013758 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:21.013758 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:21.013758 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:21.013758 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:21.013758 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:21.013758 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:21.013758 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:21.013758 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:21.013758 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:21.013758 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:21.013758 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:21.013758 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:21.016050 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb03e87-e2fd-4a5e-8343-73d5f6e86e3b None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:21.017015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 56/110] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:21.018096 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8fbfa-93a5-4636-a439-e91999ee1b56 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:21.054038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f53e29-f077-4278-8c2a-197aa65b37a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:21.054768 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f53e29-f077-4278-8c2a-197aa65b37a3 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:21.055124 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f53e29-f077-4278-8c2a-197aa65b37a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:21.055478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f53e29-f077-4278-8c2a-197aa65b37a3 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:21.056315 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f53e29-f077-4278-8c2a-197aa65b37a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:21.056693 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f53e29-f077-4278-8c2a-197aa65b37a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:21.058829 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f53e29-f077-4278-8c2a-197aa65b37a3 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:21.072127 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 55/111] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:10:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:21.073542 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a7329-1d89-454d-b8e7-fa74c1915440 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:21.074649 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a7329-1d89-454d-b8e7-fa74c1915440 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:21.075003 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a7329-1d89-454d-b8e7-fa74c1915440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:21.093622 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-509a7329-1d89-454d-b8e7-fa74c1915440 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:21.094905 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-509a7329-1d89-454d-b8e7-fa74c1915440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:21.131325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8fbfa-93a5-4636-a439-e91999ee1b56 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:21.169166 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b4fea-91ba-4643-9d28-d07129b6d2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:21.170151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b4fea-91ba-4643-9d28-d07129b6d2fe None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:21.170628 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b4fea-91ba-4643-9d28-d07129b6d2fe None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:21.171168 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b4fea-91ba-4643-9d28-d07129b6d2fe None admin] PATH_INFO: `/v3/users/6d0e2c6f0e0343118653a302efb265d8` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:21.172618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b4fea-91ba-4643-9d28-d07129b6d2fe None admin] RBAC: Authorizing `identity:get_user(user_id=6d0e2c6f0e0343118653a302efb265d8)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:21.173205 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 56/112] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:21.174145 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a7329-1d89-454d-b8e7-fa74c1915440 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:21.174817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b4fea-91ba-4643-9d28-d07129b6d2fe None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:21.181323 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 57/113] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:21 2022] GET /identity/v3/users/6d0e2c6f0e0343118653a302efb265d8 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:21.182632 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b4fea-91ba-4643-9d28-d07129b6d2fe None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:21.198345 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:21.226869 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:21.306436 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b4fea-91ba-4643-9d28-d07129b6d2fe None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:21.338002 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a7329-1d89-454d-b8e7-fa74c1915440 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:21.343131 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887aceeb-2466-4e90-b20e-9f4cc520dce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:21.343887 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887aceeb-2466-4e90-b20e-9f4cc520dce1 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:21.344274 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887aceeb-2466-4e90-b20e-9f4cc520dce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:21.344647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887aceeb-2466-4e90-b20e-9f4cc520dce1 None admin] PATH_INFO: `/v3/users/6d0e2c6f0e0343118653a302efb265d8` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:21.345939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887aceeb-2466-4e90-b20e-9f4cc520dce1 None admin] RBAC: Authorizing `identity:get_user(user_id=6d0e2c6f0e0343118653a302efb265d8)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:21.347631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887aceeb-2466-4e90-b20e-9f4cc520dce1 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:21.349787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 58/114] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:21 2022] GET /identity/v3/users/6d0e2c6f0e0343118653a302efb265d8 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:21.350779 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887aceeb-2466-4e90-b20e-9f4cc520dce1 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:21.381092 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cb935-3569-41f5-93ff-67f4f3503785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:21.382064 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cb935-3569-41f5-93ff-67f4f3503785 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:21.382798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cb935-3569-41f5-93ff-67f4f3503785 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:21.383521 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cb935-3569-41f5-93ff-67f4f3503785 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:21.384338 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99cb935-3569-41f5-93ff-67f4f3503785 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:21.384967 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99cb935-3569-41f5-93ff-67f4f3503785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:21.387385 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99cb935-3569-41f5-93ff-67f4f3503785 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:21.397798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 57/115] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:21.399230 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cb935-3569-41f5-93ff-67f4f3503785 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:21.462954 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887aceeb-2466-4e90-b20e-9f4cc520dce1 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:21.470614 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:21.490780 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:21.497648 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705a29f-620e-4a20-897d-914587e2daed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:21.498289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705a29f-620e-4a20-897d-914587e2daed None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:21.498629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705a29f-620e-4a20-897d-914587e2daed None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:21.498906 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705a29f-620e-4a20-897d-914587e2daed None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:21.500048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705a29f-620e-4a20-897d-914587e2daed None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:21.501549 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705a29f-620e-4a20-897d-914587e2daed None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:21.503372 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 59/116] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:21 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:21.504030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705a29f-620e-4a20-897d-914587e2daed None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:21.521786 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cb935-3569-41f5-93ff-67f4f3503785 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:21.559649 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f44cb2-aebb-4f22-a9ce-27da57bcdf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:21.560293 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f44cb2-aebb-4f22-a9ce-27da57bcdf15 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:21.560645 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f44cb2-aebb-4f22-a9ce-27da57bcdf15 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:21.561110 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f44cb2-aebb-4f22-a9ce-27da57bcdf15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:21.571608 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f44cb2-aebb-4f22-a9ce-27da57bcdf15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:21.577448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-43f44cb2-aebb-4f22-a9ce-27da57bcdf15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:21.577448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:21.577448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:21.577448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:21.577448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:21.577448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:21.577448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:21.577448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:21.577448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:21.577448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:21.577448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:21.577448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:21.577448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:21.577448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:21.577448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:21.577448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:21.578337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:21.578337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:21.578337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:21.578337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:21.578337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:21.578337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:21.578337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:21.578337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:21.578337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:21.578337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:21.578337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:21.578337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:21.578337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:21.578337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:21.578337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:21.578337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:21.579108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:21.579108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:21.579108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:21.579108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:21.579108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:21.579108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:21.579108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:21.579108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:21.579108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:21.579108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:21.579108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:21.579108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:21.579108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 58/117] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:10:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:21.579731 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f44cb2-aebb-4f22-a9ce-27da57bcdf15 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:21.611819 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705a29f-620e-4a20-897d-914587e2daed None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:21.646697 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2494db5-953d-4e44-881f-aff9bc04a25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:21.647438 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2494db5-953d-4e44-881f-aff9bc04a25a None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:21.647626 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2494db5-953d-4e44-881f-aff9bc04a25a None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:21.647863 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2494db5-953d-4e44-881f-aff9bc04a25a None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:21.649046 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2494db5-953d-4e44-881f-aff9bc04a25a None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:21.650513 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2494db5-953d-4e44-881f-aff9bc04a25a None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:21.652721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 60/118] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:21 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:21.658053 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d9317-0eae-47cb-af4a-d1a325f3a18d None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:21.658053 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d9317-0eae-47cb-af4a-d1a325f3a18d None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:21.658053 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d9317-0eae-47cb-af4a-d1a325f3a18d None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:21.658053 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 61/119] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:21.658053 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d9317-0eae-47cb-af4a-d1a325f3a18d None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:21.681657 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f44cb2-aebb-4f22-a9ce-27da57bcdf15 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:21.705684 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:21.715990 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1853f-93e5-4256-b412-08c03344b412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:21.716566 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1853f-93e5-4256-b412-08c03344b412 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:21.716866 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1853f-93e5-4256-b412-08c03344b412 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:21.717148 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1853f-93e5-4256-b412-08c03344b412 None admin] PATH_INFO: `/v3/users/249e03b998c74221ab0a20db43acee08` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:21.719790 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:21.732490 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1853f-93e5-4256-b412-08c03344b412 None admin] RBAC: Authorizing `identity:get_user(user_id=249e03b998c74221ab0a20db43acee08)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:21.734029 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1853f-93e5-4256-b412-08c03344b412 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:21.735707 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 59/120] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:21 2022] GET /identity/v3/users/249e03b998c74221ab0a20db43acee08 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:21.739056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1853f-93e5-4256-b412-08c03344b412 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:21.764432 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d9317-0eae-47cb-af4a-d1a325f3a18d None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:21.799734 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbd413-5ba6-412a-9bed-3e1361ea7535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:21.800408 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbd413-5ba6-412a-9bed-3e1361ea7535 None admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:21.800679 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbd413-5ba6-412a-9bed-3e1361ea7535 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:21.801005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbd413-5ba6-412a-9bed-3e1361ea7535 None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31/users/6d0e2c6f0e0343118653a302efb265d8/roles/f8c07e35d799437cbb53316acc2fc030` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:21.806622 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbd413-5ba6-412a-9bed-3e1361ea7535 None admin] RBAC: Authorizing `identity:create_grant(project_id=926d0bea317c4b8a9c79dcb750be0c31, user_id=6d0e2c6f0e0343118653a302efb265d8, role_id=f8c07e35d799437cbb53316acc2fc030)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:21.808766 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbd413-5ba6-412a-9bed-3e1361ea7535 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:21.838668 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1853f-93e5-4256-b412-08c03344b412 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:21.870441 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 62/121] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Aug 19 01:10:21 2022] PUT /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31/users/6d0e2c6f0e0343118653a302efb265d8/roles/f8c07e35d799437cbb53316acc2fc030 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:10:21.871916 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbd413-5ba6-412a-9bed-3e1361ea7535 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:21.874235 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c7113-99f8-426e-8f4c-fa28807041b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:21.875032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c7113-99f8-426e-8f4c-fa28807041b1 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:21.875322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c7113-99f8-426e-8f4c-fa28807041b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:21.875603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c7113-99f8-426e-8f4c-fa28807041b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:21.876954 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c7113-99f8-426e-8f4c-fa28807041b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:21.878534 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c7113-99f8-426e-8f4c-fa28807041b1 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:21.880524 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 60/122] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:10:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:21.881980 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c7113-99f8-426e-8f4c-fa28807041b1 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:21.957752 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:21.991527 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbd413-5ba6-412a-9bed-3e1361ea7535 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:21.993401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:22.002992 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c7113-99f8-426e-8f4c-fa28807041b1 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:22.031594 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15362eb3-1d00-4807-8756-03b1f76a2219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:22.032633 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362eb3-1d00-4807-8756-03b1f76a2219 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:22.033438 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362eb3-1d00-4807-8756-03b1f76a2219 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:22.033721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362eb3-1d00-4807-8756-03b1f76a2219 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:22.034418 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15362eb3-1d00-4807-8756-03b1f76a2219 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:22.034725 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15362eb3-1d00-4807-8756-03b1f76a2219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:22.036168 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15362eb3-1d00-4807-8756-03b1f76a2219 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:22.044521 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab78690-1ada-4ae2-8c4d-fae20041686d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:22.045710 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab78690-1ada-4ae2-8c4d-fae20041686d None admin] REQUEST_METHOD: `PUT` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:22.046173 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab78690-1ada-4ae2-8c4d-fae20041686d None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:22.046625 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab78690-1ada-4ae2-8c4d-fae20041686d None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31/users/6d0e2c6f0e0343118653a302efb265d8/roles/63d0d2b4616248b3aa738ec590e2e4b3` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:22.047208 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 63/123] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:22.048387 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748829b2-eb0c-4c80-86f5-9361c2e74f3b None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:22.048783 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748829b2-eb0c-4c80-86f5-9361c2e74f3b None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:22.049161 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748829b2-eb0c-4c80-86f5-9361c2e74f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:22.051647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab78690-1ada-4ae2-8c4d-fae20041686d None admin] RBAC: Authorizing `identity:create_grant(project_id=926d0bea317c4b8a9c79dcb750be0c31, user_id=6d0e2c6f0e0343118653a302efb265d8, role_id=63d0d2b4616248b3aa738ec590e2e4b3)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:22.056776 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab78690-1ada-4ae2-8c4d-fae20041686d None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:22.073122 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-748829b2-eb0c-4c80-86f5-9361c2e74f3b None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:22.074446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-748829b2-eb0c-4c80-86f5-9361c2e74f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:22.125139 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 61/124] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Aug 19 01:10:21 2022] PUT /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31/users/6d0e2c6f0e0343118653a302efb265d8/roles/63d0d2b4616248b3aa738ec590e2e4b3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:10:22.126034 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab78690-1ada-4ae2-8c4d-fae20041686d None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:22.159910 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 64/125] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:22.165135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748829b2-eb0c-4c80-86f5-9361c2e74f3b None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:22.329762 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab78690-1ada-4ae2-8c4d-fae20041686d None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:22.358188 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:22.365777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:22.373895 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748829b2-eb0c-4c80-86f5-9361c2e74f3b None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:22.374419 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b49efa-df2e-4a6b-ae9f-cbca24128614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:22.375048 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b49efa-df2e-4a6b-ae9f-cbca24128614 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:22.375501 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b49efa-df2e-4a6b-ae9f-cbca24128614 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:22.375784 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b49efa-df2e-4a6b-ae9f-cbca24128614 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:22.423366 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666ec4-bf8f-4efd-93fb-c022d25fc7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:22.424204 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666ec4-bf8f-4efd-93fb-c022d25fc7dc None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:22.425798 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666ec4-bf8f-4efd-93fb-c022d25fc7dc None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:22.427369 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666ec4-bf8f-4efd-93fb-c022d25fc7dc None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:22.428631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52666ec4-bf8f-4efd-93fb-c022d25fc7dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:22.430356 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52666ec4-bf8f-4efd-93fb-c022d25fc7dc None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:22.489150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b49efa-df2e-4a6b-ae9f-cbca24128614 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:22.490712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b49efa-df2e-4a6b-ae9f-cbca24128614 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:22.520657 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 65/126] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Aug 19 01:10:22 2022] POST /identity/v3/projects => generated 302 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:10:22.523517 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666ec4-bf8f-4efd-93fb-c022d25fc7dc None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:22.693943 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 62/127] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:22.695113 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b49efa-df2e-4a6b-ae9f-cbca24128614 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:22.727385 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:22.760291 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666ec4-bf8f-4efd-93fb-c022d25fc7dc None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:22.818197 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c92e33-7c27-4b33-9ab9-f14e8732c51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:22.819012 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c92e33-7c27-4b33-9ab9-f14e8732c51f None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:22.819732 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c92e33-7c27-4b33-9ab9-f14e8732c51f None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:22.820131 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c92e33-7c27-4b33-9ab9-f14e8732c51f None admin] PATH_INFO: `/v3/users/93e416b080ca43b493d7d04aa867adf6` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:22.821714 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c92e33-7c27-4b33-9ab9-f14e8732c51f None admin] RBAC: Authorizing `identity:get_user(user_id=93e416b080ca43b493d7d04aa867adf6)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:22.823552 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b49efa-df2e-4a6b-ae9f-cbca24128614 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:22.823722 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c92e33-7c27-4b33-9ab9-f14e8732c51f None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:22.826082 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 66/128] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:22 2022] GET /identity/v3/users/93e416b080ca43b493d7d04aa867adf6 => generated 247 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:22.827809 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c92e33-7c27-4b33-9ab9-f14e8732c51f None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:22.847841 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:22.866115 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77c37-f142-4532-b4c5-f9d0dfdc37a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:22.867417 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77c37-f142-4532-b4c5-f9d0dfdc37a7 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:22.867916 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77c37-f142-4532-b4c5-f9d0dfdc37a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:22.869128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77c37-f142-4532-b4c5-f9d0dfdc37a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:22.881980 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b77c37-f142-4532-b4c5-f9d0dfdc37a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:22.887744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-66b77c37-f142-4532-b4c5-f9d0dfdc37a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:22.887744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:22.887744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:22.887744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:22.887744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:22.887744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:22.887744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:22.887744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:22.887744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:22.887744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:22.887744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:22.887744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:22.887744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:22.887744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:22.887744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:22.887744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:22.888620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:22.888620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:22.888620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:22.888620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:22.888620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:22.888620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:22.888620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:22.888620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:22.888620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:22.888620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:22.888620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:22.888620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:22.888620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:22.888620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:22.888620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:22.888620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:22.889461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:22.889461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:22.889461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:22.889461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:22.889461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:22.889461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:22.889461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:22.889461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:22.889461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:22.889461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:22.889461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:22.889461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:22.891986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 63/129] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:22.893013 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77c37-f142-4532-b4c5-f9d0dfdc37a7 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:22.968142 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c92e33-7c27-4b33-9ab9-f14e8732c51f None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:23.012902 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:23.014959 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf3da9-8ab2-4b17-9e9a-c7ffeb2c5a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:23.015611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf3da9-8ab2-4b17-9e9a-c7ffeb2c5a43 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:23.015893 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf3da9-8ab2-4b17-9e9a-c7ffeb2c5a43 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:23.016170 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf3da9-8ab2-4b17-9e9a-c7ffeb2c5a43 None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:23.021544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf3da9-8ab2-4b17-9e9a-c7ffeb2c5a43 None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:23.024021 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf3da9-8ab2-4b17-9e9a-c7ffeb2c5a43 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:23.026084 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 67/130] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:22 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:23.026084 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf3da9-8ab2-4b17-9e9a-c7ffeb2c5a43 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:23.046925 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77c37-f142-4532-b4c5-f9d0dfdc37a7 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:23.118704 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034d336-2926-48e6-bb0e-3cd6e3dc7eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:23.119952 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034d336-2926-48e6-bb0e-3cd6e3dc7eae None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:23.120954 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034d336-2926-48e6-bb0e-3cd6e3dc7eae None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:23.121424 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034d336-2926-48e6-bb0e-3cd6e3dc7eae None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:23.123187 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034d336-2926-48e6-bb0e-3cd6e3dc7eae None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:23.129340 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034d336-2926-48e6-bb0e-3cd6e3dc7eae None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:23.131216 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 64/131] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:22 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:23.139618 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034d336-2926-48e6-bb0e-3cd6e3dc7eae None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:23.177233 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:23.209618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf3da9-8ab2-4b17-9e9a-c7ffeb2c5a43 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:23.251891 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034d336-2926-48e6-bb0e-3cd6e3dc7eae None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:23.283127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02240a99-2fa0-4eaa-8ffb-b45974e5d9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:23.283755 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02240a99-2fa0-4eaa-8ffb-b45974e5d9f9 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:23.284044 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02240a99-2fa0-4eaa-8ffb-b45974e5d9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:23.284318 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02240a99-2fa0-4eaa-8ffb-b45974e5d9f9 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:23.285089 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02240a99-2fa0-4eaa-8ffb-b45974e5d9f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:23.285400 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02240a99-2fa0-4eaa-8ffb-b45974e5d9f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:23.286779 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02240a99-2fa0-4eaa-8ffb-b45974e5d9f9 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:23.287665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611ce20-ac67-4897-9a39-e1787d4a79e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:23.288271 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611ce20-ac67-4897-9a39-e1787d4a79e0 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:23.288550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611ce20-ac67-4897-9a39-e1787d4a79e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:23.288824 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611ce20-ac67-4897-9a39-e1787d4a79e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:23.289568 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611ce20-ac67-4897-9a39-e1787d4a79e0 None admin] RBAC: Adding query filter params (role.id=a39067aef3054bfb828616339857085f, scope.project.id=926d0bea317c4b8a9c79dcb750be0c31, user.id=249e03b998c74221ab0a20db43acee08) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:23.289876 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611ce20-ac67-4897-9a39-e1787d4a79e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:23.291388 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611ce20-ac67-4897-9a39-e1787d4a79e0 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:23.297619 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 65/132] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:23 2022] GET /identity/v3/role_assignments?user.id=249e03b998c74221ab0a20db43acee08&scope.project.id=926d0bea317c4b8a9c79dcb750be0c31&role.id=a39067aef3054bfb828616339857085f => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:23.298308 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611ce20-ac67-4897-9a39-e1787d4a79e0 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:23.307343 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 68/133] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:23.309127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02240a99-2fa0-4eaa-8ffb-b45974e5d9f9 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:23.317983 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:23.418902 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611ce20-ac67-4897-9a39-e1787d4a79e0 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:23.459807 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87225286-7a3b-45a9-84e9-8b18a2f0d311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:23.460896 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87225286-7a3b-45a9-84e9-8b18a2f0d311 None admin] REQUEST_METHOD: `PUT` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:23.461835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87225286-7a3b-45a9-84e9-8b18a2f0d311 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:23.462517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87225286-7a3b-45a9-84e9-8b18a2f0d311 None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31/users/93e416b080ca43b493d7d04aa867adf6/roles/fda5389edef24d6baac46d87242d285b` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:23.466520 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87225286-7a3b-45a9-84e9-8b18a2f0d311 None admin] RBAC: Authorizing `identity:create_grant(project_id=926d0bea317c4b8a9c79dcb750be0c31, user_id=93e416b080ca43b493d7d04aa867adf6, role_id=fda5389edef24d6baac46d87242d285b)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:23.468376 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87225286-7a3b-45a9-84e9-8b18a2f0d311 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:23.493729 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02240a99-2fa0-4eaa-8ffb-b45974e5d9f9 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:23.557434 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 66/134] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Aug 19 01:10:23 2022] PUT /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31/users/93e416b080ca43b493d7d04aa867adf6/roles/fda5389edef24d6baac46d87242d285b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:10:23.565284 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38514ec-3471-4290-8bb2-be89ef078ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:23.566404 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38514ec-3471-4290-8bb2-be89ef078ffa None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:23.566916 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38514ec-3471-4290-8bb2-be89ef078ffa None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:23.567393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38514ec-3471-4290-8bb2-be89ef078ffa None admin] PATH_INFO: `/v3/users/6d0e2c6f0e0343118653a302efb265d8` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:23.569000 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38514ec-3471-4290-8bb2-be89ef078ffa None admin] RBAC: Authorizing `identity:get_user(user_id=6d0e2c6f0e0343118653a302efb265d8)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:23.571088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38514ec-3471-4290-8bb2-be89ef078ffa None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:23.573059 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 69/135] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:23 2022] GET /identity/v3/users/6d0e2c6f0e0343118653a302efb265d8 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:23.579827 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87225286-7a3b-45a9-84e9-8b18a2f0d311 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:23.671880 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:23.708567 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87225286-7a3b-45a9-84e9-8b18a2f0d311 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:23.754131 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd0cca-7f28-4d82-aa7d-0f2b9d696627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:23.755164 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd0cca-7f28-4d82-aa7d-0f2b9d696627 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:23.755673 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd0cca-7f28-4d82-aa7d-0f2b9d696627 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:23.757131 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd0cca-7f28-4d82-aa7d-0f2b9d696627 None admin] PATH_INFO: `/v3/projects/4091c6ec4bc7465eaf8401cfae0300da` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:23.758622 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd0cca-7f28-4d82-aa7d-0f2b9d696627 None admin] RBAC: Authorizing `identity:get_project(project_id=4091c6ec4bc7465eaf8401cfae0300da)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:23.760338 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd0cca-7f28-4d82-aa7d-0f2b9d696627 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:23.764113 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 67/136] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:23 2022] GET /identity/v3/projects/4091c6ec4bc7465eaf8401cfae0300da => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:23.770577 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38514ec-3471-4290-8bb2-be89ef078ffa None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:23.788160 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:23.900813 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38514ec-3471-4290-8bb2-be89ef078ffa None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:23.947958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6569a-fe82-48c1-86db-1fb87cb16380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:23.949603 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6569a-fe82-48c1-86db-1fb87cb16380 None admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:23.950812 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6569a-fe82-48c1-86db-1fb87cb16380 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:23.951458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6569a-fe82-48c1-86db-1fb87cb16380 None admin] PATH_INFO: `/v3/projects/4091c6ec4bc7465eaf8401cfae0300da/users/6d0e2c6f0e0343118653a302efb265d8/roles/f8c07e35d799437cbb53316acc2fc030` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:23.953877 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6569a-fe82-48c1-86db-1fb87cb16380 None admin] RBAC: Authorizing `identity:create_grant(project_id=4091c6ec4bc7465eaf8401cfae0300da, user_id=6d0e2c6f0e0343118653a302efb265d8, role_id=f8c07e35d799437cbb53316acc2fc030)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:23.955615 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6569a-fe82-48c1-86db-1fb87cb16380 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:24.046480 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 70/137] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Aug 19 01:10:23 2022] PUT /identity/v3/projects/4091c6ec4bc7465eaf8401cfae0300da/users/6d0e2c6f0e0343118653a302efb265d8/roles/f8c07e35d799437cbb53316acc2fc030 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:10:24.748610 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f303a-ff38-4e91-9a32-f6a4ee6f4ca7 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:24.749146 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f303a-ff38-4e91-9a32-f6a4ee6f4ca7 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:24.749219 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f303a-ff38-4e91-9a32-f6a4ee6f4ca7 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:24.750547 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 68/138] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:24.755780 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22e3ff-2dd1-431c-8f36-9255d51c3856 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:24.756078 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22e3ff-2dd1-431c-8f36-9255d51c3856 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:24.756356 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22e3ff-2dd1-431c-8f36-9255d51c3856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:24.774819 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-1f22e3ff-2dd1-431c-8f36-9255d51c3856 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:24.776007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-1f22e3ff-2dd1-431c-8f36-9255d51c3856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:24.853147 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 71/139] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:25.032261 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fc6ee-d516-4b17-89d6-822b68982d42 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:25.032650 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fc6ee-d516-4b17-89d6-822b68982d42 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:25.033033 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fc6ee-d516-4b17-89d6-822b68982d42 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:25.034437 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 69/140] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:25.039683 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b343-059d-4864-917d-518afd70cdfd None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:25.040121 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b343-059d-4864-917d-518afd70cdfd None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:25.040253 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b343-059d-4864-917d-518afd70cdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:25.050686 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:25.069873 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-f680b343-059d-4864-917d-518afd70cdfd None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:25.071107 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-f680b343-059d-4864-917d-518afd70cdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:25.163244 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 72/141] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:25.518501 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fc6ee-d516-4b17-89d6-822b68982d42 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:25.666779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fc6ee-d516-4b17-89d6-822b68982d42 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:25.712268 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1095eb-c3fe-4d38-8411-8cb2b1447bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:25.712928 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1095eb-c3fe-4d38-8411-8cb2b1447bbf None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:25.713216 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1095eb-c3fe-4d38-8411-8cb2b1447bbf None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:25.713490 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1095eb-c3fe-4d38-8411-8cb2b1447bbf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:25.729557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1095eb-c3fe-4d38-8411-8cb2b1447bbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:25.735472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-6c1095eb-c3fe-4d38-8411-8cb2b1447bbf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:25.735472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:25.735472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:25.735472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:25.735472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:25.735472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:25.735472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:25.735472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:25.735472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:25.735472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:25.735472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:25.735472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:25.735472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:25.735472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:25.735472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:25.735472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:25.736283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:25.736283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:25.736283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:25.736283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:25.736283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:25.736283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:25.736283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:25.736283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:25.736283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:25.736283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:25.736283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:25.736283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:25.736283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:25.736283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:25.736283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:25.736283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:25.737136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:25.737136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:25.737136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:25.737136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:25.737136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:25.737136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:25.737136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:25.737136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:25.737136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:25.737136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:25.737136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:25.737136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:25.737136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 70/142] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:25.742475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680b343-059d-4864-917d-518afd70cdfd None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:25.831482 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e320b-72f6-4701-8fdf-abdd9901b565 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:25.831975 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e320b-72f6-4701-8fdf-abdd9901b565 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:25.831975 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e320b-72f6-4701-8fdf-abdd9901b565 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:25.833535 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 71/143] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:25.838652 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241a082-15ea-4634-a74f-0f9f7e99bc4d None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:25.838932 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241a082-15ea-4634-a74f-0f9f7e99bc4d None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:25.839206 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241a082-15ea-4634-a74f-0f9f7e99bc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:25.846069 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:25.868866 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-6241a082-15ea-4634-a74f-0f9f7e99bc4d None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:25.870111 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-6241a082-15ea-4634-a74f-0f9f7e99bc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:25.914508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680b343-059d-4864-917d-518afd70cdfd None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:25.977342 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:25.987505 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08931843-c9b4-45fc-a9ed-4e699f7128fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:25.989206 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08931843-c9b4-45fc-a9ed-4e699f7128fe None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:25.989835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08931843-c9b4-45fc-a9ed-4e699f7128fe None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:25.991275 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08931843-c9b4-45fc-a9ed-4e699f7128fe None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:25.992265 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08931843-c9b4-45fc-a9ed-4e699f7128fe None admin] RBAC: Adding query filter params (name=member) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:25.993537 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08931843-c9b4-45fc-a9ed-4e699f7128fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:25.995883 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08931843-c9b4-45fc-a9ed-4e699f7128fe None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:26.008598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 72/144] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 19 01:10:26.009756 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241a082-15ea-4634-a74f-0f9f7e99bc4d None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:26.023390 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 73/145] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:26.028718 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08931843-c9b4-45fc-a9ed-4e699f7128fe None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:26.235760 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08931843-c9b4-45fc-a9ed-4e699f7128fe None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:26.265203 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241a082-15ea-4634-a74f-0f9f7e99bc4d None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:26.324824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb76ea4-5b8c-45f0-859f-8005b2522846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:26.325498 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb76ea4-5b8c-45f0-859f-8005b2522846 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:26.325777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb76ea4-5b8c-45f0-859f-8005b2522846 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:26.326046 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb76ea4-5b8c-45f0-859f-8005b2522846 None admin] PATH_INFO: `/v3/users/6d0e2c6f0e0343118653a302efb265d8` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:26.327444 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb76ea4-5b8c-45f0-859f-8005b2522846 None admin] RBAC: Authorizing `identity:get_user(user_id=6d0e2c6f0e0343118653a302efb265d8)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:26.329109 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb76ea4-5b8c-45f0-859f-8005b2522846 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:26.330971 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:26.332075 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 74/146] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:26 2022] GET /identity/v3/users/6d0e2c6f0e0343118653a302efb265d8 => generated 275 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:26.337645 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb76ea4-5b8c-45f0-859f-8005b2522846 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:26.350133 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c0f6c-7339-415c-8a38-6086e13bda53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:26.351237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c0f6c-7339-415c-8a38-6086e13bda53 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:26.351690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c0f6c-7339-415c-8a38-6086e13bda53 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:26.352552 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c0f6c-7339-415c-8a38-6086e13bda53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:26.373306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c0f6c-7339-415c-8a38-6086e13bda53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:26.389560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-f35c0f6c-7339-415c-8a38-6086e13bda53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:10:26.389560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:26.389560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:26.389560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:26.389560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:26.389560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:26.389560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:26.389560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:26.389560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:26.389560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:26.389560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:26.389560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:26.389560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:26.389560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:26.389560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:26.389560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:26.390884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:26.390884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:26.390884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:26.390884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:26.390884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:26.390884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:26.390884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:26.390884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:26.390884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:26.390884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:26.390884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:26.390884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:26.390884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:26.390884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:26.390884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:26.390884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:26.391880 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:26.391880 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:26.391880 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:26.391880 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:26.391880 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:26.391880 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:26.391880 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:26.391880 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:26.391880 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:26.391880 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:26.391880 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:10:26.391880 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:26.391880 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 73/147] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:10:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:26.398731 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c0f6c-7339-415c-8a38-6086e13bda53 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:26.496521 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:26.557875 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c0f6c-7339-415c-8a38-6086e13bda53 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:26.612617 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb76ea4-5b8c-45f0-859f-8005b2522846 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:26.635336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab69599-baa4-4544-b16b-7bad91e382d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:26.636833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab69599-baa4-4544-b16b-7bad91e382d2 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:26.637147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab69599-baa4-4544-b16b-7bad91e382d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:26.637413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab69599-baa4-4544-b16b-7bad91e382d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:26.638098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab69599-baa4-4544-b16b-7bad91e382d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:26.638402 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab69599-baa4-4544-b16b-7bad91e382d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:26.641032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab69599-baa4-4544-b16b-7bad91e382d2 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:26.663718 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 74/148] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:10:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:26.671460 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab69599-baa4-4544-b16b-7bad91e382d2 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:26.682866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2702bd-55d6-4a96-bf6d-4dc5e3c4e398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:26.683557 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2702bd-55d6-4a96-bf6d-4dc5e3c4e398 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:26.684412 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2702bd-55d6-4a96-bf6d-4dc5e3c4e398 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:26.684691 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2702bd-55d6-4a96-bf6d-4dc5e3c4e398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:26.812419 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:26.821357 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2702bd-55d6-4a96-bf6d-4dc5e3c4e398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:26.823199 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2702bd-55d6-4a96-bf6d-4dc5e3c4e398 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:26.882418 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab69599-baa4-4544-b16b-7bad91e382d2 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:26.897321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:26.934624 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b5737-82fb-442a-be60-4862839cca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:26.935648 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b5737-82fb-442a-be60-4862839cca02 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:26.936122 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b5737-82fb-442a-be60-4862839cca02 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:26.936602 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b5737-82fb-442a-be60-4862839cca02 None admin] PATH_INFO: `/v3/users/6d0e2c6f0e0343118653a302efb265d8` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:26.938214 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b5737-82fb-442a-be60-4862839cca02 None admin] RBAC: Authorizing `identity:get_user(user_id=6d0e2c6f0e0343118653a302efb265d8)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:26.939997 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b5737-82fb-442a-be60-4862839cca02 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:26.941934 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 75/149] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:26 2022] GET /identity/v3/users/6d0e2c6f0e0343118653a302efb265d8 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:26.949435 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b5737-82fb-442a-be60-4862839cca02 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:26.959750 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 75/150] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 01:10:26.962063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd045464-b40a-49f0-abe9-7484eaeca6ee None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:26.962548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd045464-b40a-49f0-abe9-7484eaeca6ee None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:26.964026 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd045464-b40a-49f0-abe9-7484eaeca6ee None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:26.966439 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 76/151] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:26.967039 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd045464-b40a-49f0-abe9-7484eaeca6ee None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:27.073247 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b5737-82fb-442a-be60-4862839cca02 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:27.088487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd045464-b40a-49f0-abe9-7484eaeca6ee None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:27.097105 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:27.109083 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17f9d7-cf6c-4465-abe6-a8e42e9bc3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:27.109720 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17f9d7-cf6c-4465-abe6-a8e42e9bc3f0 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:27.109997 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17f9d7-cf6c-4465-abe6-a8e42e9bc3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:27.110267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17f9d7-cf6c-4465-abe6-a8e42e9bc3f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:27.112253 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17f9d7-cf6c-4465-abe6-a8e42e9bc3f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:27.113368 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17f9d7-cf6c-4465-abe6-a8e42e9bc3f0 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:27.119218 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 76/152] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:10:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:27.119218 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46133e8-144b-4328-be21-d762124178de None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:27.119218 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46133e8-144b-4328-be21-d762124178de None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:27.119218 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46133e8-144b-4328-be21-d762124178de None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:27.119218 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 77/153] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:27.119218 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46133e8-144b-4328-be21-d762124178de None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:27.132845 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bef29e-6657-446e-b781-dccd6eed7a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:27.133528 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bef29e-6657-446e-b781-dccd6eed7a4a None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:27.133792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bef29e-6657-446e-b781-dccd6eed7a4a None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:27.134052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bef29e-6657-446e-b781-dccd6eed7a4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:27.169343 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:27.209641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bef29e-6657-446e-b781-dccd6eed7a4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:27.211119 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bef29e-6657-446e-b781-dccd6eed7a4a None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:27.245115 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46133e8-144b-4328-be21-d762124178de None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:27.283049 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813efb5-0342-44f9-9155-a6cb1b2875cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:27.283697 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813efb5-0342-44f9-9155-a6cb1b2875cd None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:27.283974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813efb5-0342-44f9-9155-a6cb1b2875cd None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:27.284250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813efb5-0342-44f9-9155-a6cb1b2875cd None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:27.285456 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813efb5-0342-44f9-9155-a6cb1b2875cd None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:27.286941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813efb5-0342-44f9-9155-a6cb1b2875cd None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:27.288782 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 78/154] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:27 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:27.289844 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d260ea1-f175-48b0-91f8-56aa76498703 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:27.290128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d260ea1-f175-48b0-91f8-56aa76498703 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:27.290399 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d260ea1-f175-48b0-91f8-56aa76498703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:27.310285 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-3d260ea1-f175-48b0-91f8-56aa76498703 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:27.311487 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-3d260ea1-f175-48b0-91f8-56aa76498703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:27.328241 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 77/155] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:27.328901 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bef29e-6657-446e-b781-dccd6eed7a4a None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:27.375903 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:27.396889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 79/156] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:27.396889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496731c-9e10-42b0-a9df-904692e52309 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:27.396889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496731c-9e10-42b0-a9df-904692e52309 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:27.396889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496731c-9e10-42b0-a9df-904692e52309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:27.413571 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:27.421936 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-9496731c-9e10-42b0-a9df-904692e52309 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:27.423380 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-9496731c-9e10-42b0-a9df-904692e52309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:27.470911 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bef29e-6657-446e-b781-dccd6eed7a4a None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:27.503970 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 80/157] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:27.505874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496731c-9e10-42b0-a9df-904692e52309 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:27.531568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0f874-8ae9-44f1-a53f-81d4ea0fe8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:27.532206 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0f874-8ae9-44f1-a53f-81d4ea0fe8eb None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:27.532490 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0f874-8ae9-44f1-a53f-81d4ea0fe8eb None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:27.532759 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0f874-8ae9-44f1-a53f-81d4ea0fe8eb None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:27.533462 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0f874-8ae9-44f1-a53f-81d4ea0fe8eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:27.534990 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0f874-8ae9-44f1-a53f-81d4ea0fe8eb None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:27.651743 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496731c-9e10-42b0-a9df-904692e52309 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:27.670177 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:27.690557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df515d43-9639-4216-b0b3-f4083335a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:27.692468 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df515d43-9639-4216-b0b3-f4083335a00b None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:27.692468 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df515d43-9639-4216-b0b3-f4083335a00b None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:27.692468 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df515d43-9639-4216-b0b3-f4083335a00b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:27.692468 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df515d43-9639-4216-b0b3-f4083335a00b None admin] RBAC: Adding query filter params (role.id=f8c07e35d799437cbb53316acc2fc030, scope.project.id=926d0bea317c4b8a9c79dcb750be0c31, user.id=6d0e2c6f0e0343118653a302efb265d8) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:27.692805 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df515d43-9639-4216-b0b3-f4083335a00b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:27.694259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df515d43-9639-4216-b0b3-f4083335a00b None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:27.700336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 81/158] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:27 2022] GET /identity/v3/role_assignments?user.id=6d0e2c6f0e0343118653a302efb265d8&scope.project.id=926d0bea317c4b8a9c79dcb750be0c31&role.id=f8c07e35d799437cbb53316acc2fc030 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:27.704691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df515d43-9639-4216-b0b3-f4083335a00b None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:27.711520 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 78/159] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Aug 19 01:10:27 2022] POST /identity/v3/users => generated 283 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:10:27.712826 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5daf9-a0bf-498e-a098-7bf5faa633cf None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:27.713159 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5daf9-a0bf-498e-a098-7bf5faa633cf None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:27.713437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5daf9-a0bf-498e-a098-7bf5faa633cf None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:27.714769 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 79/160] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:27.723273 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b39f0-4cba-424e-9926-1733981243d9 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:27.723562 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b39f0-4cba-424e-9926-1733981243d9 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:27.723836 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b39f0-4cba-424e-9926-1733981243d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:27.769756 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-b52b39f0-4cba-424e-9926-1733981243d9 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:27.772680 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-b52b39f0-4cba-424e-9926-1733981243d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:27.872297 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df515d43-9639-4216-b0b3-f4083335a00b None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:27.903775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 80/161] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:27.910340 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b39f0-4cba-424e-9926-1733981243d9 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:27.946220 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb508b-5fba-4fae-b4b2-54f2ad1b6923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:27.947710 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb508b-5fba-4fae-b4b2-54f2ad1b6923 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:27.948305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb508b-5fba-4fae-b4b2-54f2ad1b6923 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:27.949716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb508b-5fba-4fae-b4b2-54f2ad1b6923 None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:27.954350 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb508b-5fba-4fae-b4b2-54f2ad1b6923 None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:27.956290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb508b-5fba-4fae-b4b2-54f2ad1b6923 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:27.960040 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 82/162] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:27 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:27.964104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb508b-5fba-4fae-b4b2-54f2ad1b6923 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:28.015401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:28.049985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:28.101124 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b39f0-4cba-424e-9926-1733981243d9 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:28.133003 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb508b-5fba-4fae-b4b2-54f2ad1b6923 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:28.151448 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02602a2b-37e3-4461-adda-5304918bb3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:28.152612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02602a2b-37e3-4461-adda-5304918bb3ea None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:28.152919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02602a2b-37e3-4461-adda-5304918bb3ea None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:28.153201 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02602a2b-37e3-4461-adda-5304918bb3ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:28.165033 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02602a2b-37e3-4461-adda-5304918bb3ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:28.170744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-02602a2b-37e3-4461-adda-5304918bb3ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:28.170744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:28.170744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:28.170744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:28.170744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:28.170744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:28.170744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:28.170744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:28.170744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:28.170744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:28.170744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:28.170744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:28.170744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:28.170744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:28.170744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:28.170744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:28.171868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:28.171868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:28.171868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:28.171868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:28.171868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:28.171868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:28.171868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:28.171868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:28.171868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:28.171868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:28.171868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:28.171868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:28.171868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:28.171868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:28.171868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:28.171868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:28.172831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:28.172831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:28.172831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:28.172831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:28.172831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:28.172831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:28.172831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:28.172831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:28.172831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:28.172831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:28.172831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:28.172831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:28.173658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c4116-f9d8-44a3-b606-ca4bcf78bd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:28.173658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c4116-f9d8-44a3-b606-ca4bcf78bd7d None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:28.173863 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 81/163] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:28.173938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c4116-f9d8-44a3-b606-ca4bcf78bd7d None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:28.173938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c4116-f9d8-44a3-b606-ca4bcf78bd7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:28.174079 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02602a2b-37e3-4461-adda-5304918bb3ea None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:28.193018 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c4116-f9d8-44a3-b606-ca4bcf78bd7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:28.198303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-f03c4116-f9d8-44a3-b606-ca4bcf78bd7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:28.198303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:28.198303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:28.198303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:28.198303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:28.198303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:28.198303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:28.198303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:28.198303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:28.198303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:28.198303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:28.198303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:28.198303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:28.198303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:28.198303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:28.198303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:28.199208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:28.199208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:28.199208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:28.199208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:28.199208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:28.199208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:28.199208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:28.199208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:28.199208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:28.199208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:28.199208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:28.199208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:28.199208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:28.199208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:28.199208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:28.199208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:28.203125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:28.203125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:28.203125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:28.203125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:28.203125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:28.203125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:28.203125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:28.203125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:28.203125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:28.203125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:28.203125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:28.203125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:28.203125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 83/164] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:10:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:28.203125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c4116-f9d8-44a3-b606-ca4bcf78bd7d None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:28.301949 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02602a2b-37e3-4461-adda-5304918bb3ea None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:28.318007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:28.326724 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c4116-f9d8-44a3-b606-ca4bcf78bd7d None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:28.342457 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:28.350964 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5dfa4-0e58-435c-9516-e86a72877d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:28.351581 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5dfa4-0e58-435c-9516-e86a72877d98 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:28.351863 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5dfa4-0e58-435c-9516-e86a72877d98 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:28.352138 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5dfa4-0e58-435c-9516-e86a72877d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:28.353004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5dfa4-0e58-435c-9516-e86a72877d98 None admin] RBAC: Adding query filter params (role.id=63d0d2b4616248b3aa738ec590e2e4b3, scope.project.id=926d0bea317c4b8a9c79dcb750be0c31, user.id=6d0e2c6f0e0343118653a302efb265d8) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:28.353319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5dfa4-0e58-435c-9516-e86a72877d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:28.354963 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5dfa4-0e58-435c-9516-e86a72877d98 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:28.363314 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 82/165] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:28 2022] GET /identity/v3/role_assignments?user.id=6d0e2c6f0e0343118653a302efb265d8&scope.project.id=926d0bea317c4b8a9c79dcb750be0c31&role.id=63d0d2b4616248b3aa738ec590e2e4b3 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:28.364072 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5dfa4-0e58-435c-9516-e86a72877d98 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:28.369015 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790da302-5f64-43fe-a006-64f1ed2d8007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:28.369900 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790da302-5f64-43fe-a006-64f1ed2d8007 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:28.370374 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790da302-5f64-43fe-a006-64f1ed2d8007 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:28.370893 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790da302-5f64-43fe-a006-64f1ed2d8007 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:28.372240 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790da302-5f64-43fe-a006-64f1ed2d8007 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:28.372759 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790da302-5f64-43fe-a006-64f1ed2d8007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:28.374523 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790da302-5f64-43fe-a006-64f1ed2d8007 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:28.384655 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 84/166] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:28.386052 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790da302-5f64-43fe-a006-64f1ed2d8007 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:28.506971 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5dfa4-0e58-435c-9516-e86a72877d98 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:28.541274 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790da302-5f64-43fe-a006-64f1ed2d8007 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:28.570931 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f54bc-c7e2-4fe8-846a-c64f3522f6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:28.571908 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f54bc-c7e2-4fe8-846a-c64f3522f6f7 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:28.572392 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f54bc-c7e2-4fe8-846a-c64f3522f6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:28.572939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f54bc-c7e2-4fe8-846a-c64f3522f6f7 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:28.574564 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f54bc-c7e2-4fe8-846a-c64f3522f6f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:28.575103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f54bc-c7e2-4fe8-846a-c64f3522f6f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:28.577363 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f54bc-c7e2-4fe8-846a-c64f3522f6f7 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:28.588843 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 83/167] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:28.591032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f54bc-c7e2-4fe8-846a-c64f3522f6f7 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:28.591739 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c54ed-9ced-4767-9725-2b161e7ca307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:28.593094 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c54ed-9ced-4767-9725-2b161e7ca307 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:28.593094 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c54ed-9ced-4767-9725-2b161e7ca307 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:28.593094 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c54ed-9ced-4767-9725-2b161e7ca307 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:28.608598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c54ed-9ced-4767-9725-2b161e7ca307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:28.615623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-1b6c54ed-9ced-4767-9725-2b161e7ca307 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:28.615623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:28.615623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:28.615623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:28.615623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:28.615623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:28.615623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:28.615623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:28.615623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:28.615623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:28.615623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:28.615623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:28.615623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:28.615623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:28.615623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:28.615623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:28.616571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:28.616571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:28.616571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:28.616571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:28.616571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:28.616571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:28.616571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:28.616571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:28.616571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:28.616571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:28.616571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:28.616571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:28.616571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:28.616571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:28.616571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:28.616571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:28.617495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:28.617495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:28.617495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:28.617495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:28.617495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:28.617495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:28.617495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:28.617495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:28.617495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:28.617495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:28.617495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:28.617495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:28.617495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 85/168] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:28.618157 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c54ed-9ced-4767-9725-2b161e7ca307 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:28.649330 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:28.666057 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:28.722722 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f54bc-c7e2-4fe8-846a-c64f3522f6f7 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:28.741098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c54ed-9ced-4767-9725-2b161e7ca307 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:28.764165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a972d6-7c63-4c53-83d2-c68711be1dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:28.765208 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a972d6-7c63-4c53-83d2-c68711be1dab None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:28.765706 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a972d6-7c63-4c53-83d2-c68711be1dab None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:28.766202 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a972d6-7c63-4c53-83d2-c68711be1dab None admin] PATH_INFO: `/v3/users/249e03b998c74221ab0a20db43acee08` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:28.767637 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a972d6-7c63-4c53-83d2-c68711be1dab None admin] RBAC: Authorizing `identity:get_user(user_id=249e03b998c74221ab0a20db43acee08)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:28.769350 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a972d6-7c63-4c53-83d2-c68711be1dab None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:28.771754 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 84/169] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:28 2022] GET /identity/v3/users/249e03b998c74221ab0a20db43acee08 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:28.772744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a972d6-7c63-4c53-83d2-c68711be1dab None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:28.783853 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0703bda-5533-4aa5-b9f0-04d545b53026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:28.784494 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0703bda-5533-4aa5-b9f0-04d545b53026 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:28.784826 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0703bda-5533-4aa5-b9f0-04d545b53026 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:28.785135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0703bda-5533-4aa5-b9f0-04d545b53026 None admin] PATH_INFO: `/v3/users/93e416b080ca43b493d7d04aa867adf6` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:28.786283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0703bda-5533-4aa5-b9f0-04d545b53026 None admin] RBAC: Authorizing `identity:get_user(user_id=93e416b080ca43b493d7d04aa867adf6)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:28.787830 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0703bda-5533-4aa5-b9f0-04d545b53026 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:28.795155 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 86/170] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:28 2022] GET /identity/v3/users/93e416b080ca43b493d7d04aa867adf6 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:28.795155 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0703bda-5533-4aa5-b9f0-04d545b53026 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:28.898965 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a972d6-7c63-4c53-83d2-c68711be1dab None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:28.900954 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:28.908432 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0703bda-5533-4aa5-b9f0-04d545b53026 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:28.911785 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:28.943549 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e8216-ebeb-433f-8eae-420002c5060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:28.944519 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8216-ebeb-433f-8eae-420002c5060b None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:28.946613 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8216-ebeb-433f-8eae-420002c5060b None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:28.947095 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8216-ebeb-433f-8eae-420002c5060b None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:28.947962 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e8216-ebeb-433f-8eae-420002c5060b None admin] RBAC: Adding query filter params (name=member) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:28.948446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e8216-ebeb-433f-8eae-420002c5060b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:28.950843 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e8216-ebeb-433f-8eae-420002c5060b None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:28.952122 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8ee8b-fbcf-4bf1-b776-85f0df7964d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:28.952955 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ee8b-fbcf-4bf1-b776-85f0df7964d9 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:28.953494 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ee8b-fbcf-4bf1-b776-85f0df7964d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:28.953833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ee8b-fbcf-4bf1-b776-85f0df7964d9 None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:28.955470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8ee8b-fbcf-4bf1-b776-85f0df7964d9 None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:28.957835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8ee8b-fbcf-4bf1-b776-85f0df7964d9 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:28.965126 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 87/171] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:28 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:28.965126 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8ee8b-fbcf-4bf1-b776-85f0df7964d9 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:28.965393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 85/172] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:28.970578 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e8216-ebeb-433f-8eae-420002c5060b None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:29.095333 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8ee8b-fbcf-4bf1-b776-85f0df7964d9 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:29.162505 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e8216-ebeb-433f-8eae-420002c5060b None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:29.169989 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ddf96-43b8-4a7f-bfdf-fa9b7a89d247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:29.174624 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ddf96-43b8-4a7f-bfdf-fa9b7a89d247 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:29.174911 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ddf96-43b8-4a7f-bfdf-fa9b7a89d247 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:29.175183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ddf96-43b8-4a7f-bfdf-fa9b7a89d247 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:29.228653 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932977b5-bc1c-4fbf-8b77-be01a5d2aaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:29.229535 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932977b5-bc1c-4fbf-8b77-be01a5d2aaf8 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:29.229819 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932977b5-bc1c-4fbf-8b77-be01a5d2aaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:29.230805 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932977b5-bc1c-4fbf-8b77-be01a5d2aaf8 None admin] PATH_INFO: `/v3/users/6d0e2c6f0e0343118653a302efb265d8` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:29.232895 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932977b5-bc1c-4fbf-8b77-be01a5d2aaf8 None admin] RBAC: Authorizing `identity:get_user(user_id=6d0e2c6f0e0343118653a302efb265d8)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:29.235620 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932977b5-bc1c-4fbf-8b77-be01a5d2aaf8 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:29.238225 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 86/173] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:28 2022] GET /identity/v3/users/6d0e2c6f0e0343118653a302efb265d8 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:29.241729 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932977b5-bc1c-4fbf-8b77-be01a5d2aaf8 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:29.243011 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:29.282895 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:29.289183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ddf96-43b8-4a7f-bfdf-fa9b7a89d247 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:29.290658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ddf96-43b8-4a7f-bfdf-fa9b7a89d247 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:29.410140 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932977b5-bc1c-4fbf-8b77-be01a5d2aaf8 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:29.456189 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ebe2a-d3ff-4edd-ba48-631deec372eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:29.456924 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ebe2a-d3ff-4edd-ba48-631deec372eb None admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:29.457212 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ebe2a-d3ff-4edd-ba48-631deec372eb None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:29.457488 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ebe2a-d3ff-4edd-ba48-631deec372eb None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31/users/249e03b998c74221ab0a20db43acee08/roles/a39067aef3054bfb828616339857085f` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:29.459580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ebe2a-d3ff-4edd-ba48-631deec372eb None admin] RBAC: Authorizing `identity:create_grant(project_id=926d0bea317c4b8a9c79dcb750be0c31, user_id=249e03b998c74221ab0a20db43acee08, role_id=a39067aef3054bfb828616339857085f)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:29.461086 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ebe2a-d3ff-4edd-ba48-631deec372eb None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:29.482845 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 88/174] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:29.483736 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ddf96-43b8-4a7f-bfdf-fa9b7a89d247 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:29.551440 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 87/175] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Aug 19 01:10:29 2022] PUT /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31/users/249e03b998c74221ab0a20db43acee08/roles/a39067aef3054bfb828616339857085f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:10:29.552292 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ebe2a-d3ff-4edd-ba48-631deec372eb None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:29.621333 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:29.664804 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ddf96-43b8-4a7f-bfdf-fa9b7a89d247 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:29.729136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dc3ac-64f2-4dd9-87ce-f77f901f049f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:29.730817 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dc3ac-64f2-4dd9-87ce-f77f901f049f None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:29.731541 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dc3ac-64f2-4dd9-87ce-f77f901f049f None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:29.732028 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dc3ac-64f2-4dd9-87ce-f77f901f049f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:29.742192 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:29.771356 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ebe2a-d3ff-4edd-ba48-631deec372eb None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:29.842802 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca61ed-7165-4893-bb4b-a4a563ae0318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:29.843697 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca61ed-7165-4893-bb4b-a4a563ae0318 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:29.844263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca61ed-7165-4893-bb4b-a4a563ae0318 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:29.844700 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca61ed-7165-4893-bb4b-a4a563ae0318 None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:29.846113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca61ed-7165-4893-bb4b-a4a563ae0318 None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:29.852896 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca61ed-7165-4893-bb4b-a4a563ae0318 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:29.856463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 88/176] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:29 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:29.863471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca61ed-7165-4893-bb4b-a4a563ae0318 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:29.885978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4dc3ac-64f2-4dd9-87ce-f77f901f049f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:29.889006 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4dc3ac-64f2-4dd9-87ce-f77f901f049f None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:30.022727 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:30.070723 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca61ed-7165-4893-bb4b-a4a563ae0318 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:30.089468 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 89/177] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:30.097388 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dc3ac-64f2-4dd9-87ce-f77f901f049f None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:30.140323 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8d609-eb04-4872-b21c-685260aad301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:30.141992 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8d609-eb04-4872-b21c-685260aad301 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:30.143086 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8d609-eb04-4872-b21c-685260aad301 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:30.143664 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8d609-eb04-4872-b21c-685260aad301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:30.146232 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8d609-eb04-4872-b21c-685260aad301 None admin] RBAC: Adding query filter params (role.id=fda5389edef24d6baac46d87242d285b, scope.project.id=926d0bea317c4b8a9c79dcb750be0c31, user.id=93e416b080ca43b493d7d04aa867adf6) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:30.147297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8d609-eb04-4872-b21c-685260aad301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:30.149188 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8d609-eb04-4872-b21c-685260aad301 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:30.160592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 89/178] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:29 2022] GET /identity/v3/role_assignments?user.id=93e416b080ca43b493d7d04aa867adf6&scope.project.id=926d0bea317c4b8a9c79dcb750be0c31&role.id=fda5389edef24d6baac46d87242d285b => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:30.281264 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dc3ac-64f2-4dd9-87ce-f77f901f049f None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:30.345542 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9360d-42e1-4ac7-8b7c-a8c0ad822b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:30.346277 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9360d-42e1-4ac7-8b7c-a8c0ad822b20 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:30.346562 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9360d-42e1-4ac7-8b7c-a8c0ad822b20 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:30.346841 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9360d-42e1-4ac7-8b7c-a8c0ad822b20 None admin] PATH_INFO: `/v3/projects/4091c6ec4bc7465eaf8401cfae0300da` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:30.348112 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9360d-42e1-4ac7-8b7c-a8c0ad822b20 None admin] RBAC: Authorizing `identity:get_project(project_id=4091c6ec4bc7465eaf8401cfae0300da)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:30.349669 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9360d-42e1-4ac7-8b7c-a8c0ad822b20 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:30.351354 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 90/179] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:30 2022] GET /identity/v3/projects/4091c6ec4bc7465eaf8401cfae0300da => generated 312 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:30.358671 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8d609-eb04-4872-b21c-685260aad301 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:30.412456 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:30.519454 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8d609-eb04-4872-b21c-685260aad301 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:30.579160 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be743917-6c2c-4e3c-8b81-e47d50e3800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:30.579774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be743917-6c2c-4e3c-8b81-e47d50e3800d None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:30.580334 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be743917-6c2c-4e3c-8b81-e47d50e3800d None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:30.580334 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be743917-6c2c-4e3c-8b81-e47d50e3800d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:30.581140 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be743917-6c2c-4e3c-8b81-e47d50e3800d None admin] RBAC: Adding query filter params (role.id=f8c07e35d799437cbb53316acc2fc030, scope.project.id=4091c6ec4bc7465eaf8401cfae0300da, user.id=6d0e2c6f0e0343118653a302efb265d8) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:30.581456 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be743917-6c2c-4e3c-8b81-e47d50e3800d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:30.582920 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be743917-6c2c-4e3c-8b81-e47d50e3800d None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:30.594385 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 90/180] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:30 2022] GET /identity/v3/role_assignments?user.id=6d0e2c6f0e0343118653a302efb265d8&scope.project.id=4091c6ec4bc7465eaf8401cfae0300da&role.id=f8c07e35d799437cbb53316acc2fc030 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:31.004970 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c065821-0b7c-4e38-b574-8b387c485f00 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:31.005813 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c065821-0b7c-4e38-b574-8b387c485f00 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:31.006326 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c065821-0b7c-4e38-b574-8b387c485f00 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:31.007866 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 91/181] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:31.013820 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd8185-7225-49bb-9d8f-18ae8896bc96 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:31.014106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd8185-7225-49bb-9d8f-18ae8896bc96 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:31.014383 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd8185-7225-49bb-9d8f-18ae8896bc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:31.040082 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-d4fd8185-7225-49bb-9d8f-18ae8896bc96 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:31.041302 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-d4fd8185-7225-49bb-9d8f-18ae8896bc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:31.129796 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 91/182] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:31.250444 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445b582-b301-4b08-bf40-b64b006afe6a None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:31.251408 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445b582-b301-4b08-bf40-b64b006afe6a None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:31.251910 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445b582-b301-4b08-bf40-b64b006afe6a None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:31.253487 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 92/183] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:31.259033 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e29ffe-0846-4162-8143-0573e8ad977e None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:31.259257 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e29ffe-0846-4162-8143-0573e8ad977e None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:31.259527 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e29ffe-0846-4162-8143-0573e8ad977e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:31.280217 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-e9e29ffe-0846-4162-8143-0573e8ad977e None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:31.281438 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-e9e29ffe-0846-4162-8143-0573e8ad977e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:31.296639 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:31.323994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddbbfb-1bf9-4367-b82e-010c18730410 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:31.324290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddbbfb-1bf9-4367-b82e-010c18730410 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:31.324552 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddbbfb-1bf9-4367-b82e-010c18730410 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:31.327280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 93/184] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:31.331888 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6975af2-c858-4890-b2f4-448a24dcd97b None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:31.332172 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6975af2-c858-4890-b2f4-448a24dcd97b None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:31.332448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6975af2-c858-4890-b2f4-448a24dcd97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:31.351417 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-a6975af2-c858-4890-b2f4-448a24dcd97b None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:31.352621 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-a6975af2-c858-4890-b2f4-448a24dcd97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:31.353350 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 92/185] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:31.384602 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:31.433008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 94/186] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:31.492223 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e29ffe-0846-4162-8143-0573e8ad977e None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:31.598915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e29ffe-0846-4162-8143-0573e8ad977e None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:31.634586 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e4447-75a6-45be-b5bd-3f485303a0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:31.635219 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e4447-75a6-45be-b5bd-3f485303a0c7 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:31.635521 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e4447-75a6-45be-b5bd-3f485303a0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:31.635792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e4447-75a6-45be-b5bd-3f485303a0c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:31.646685 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e4447-75a6-45be-b5bd-3f485303a0c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:31.651548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-f54e4447-75a6-45be-b5bd-3f485303a0c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:31.651548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:31.651548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:31.651548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:31.651548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:31.651548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:31.651548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:31.651548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:31.651548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:31.651548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:31.651548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:31.651548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:31.651548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:31.651548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:31.651548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:31.651548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:31.652452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:31.652452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:31.652452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:31.652452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:31.652452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:31.652452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:31.652452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:31.652452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:31.652452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:31.652452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:31.652452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:31.652452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:31.652452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:31.652452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:31.652452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:31.652452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:31.653271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:31.653271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:31.653271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:31.653271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:31.653271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:31.653271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:31.653271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:31.653271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:31.653271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:31.653271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:31.653271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:31.653271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:31.653271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 93/187] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:10:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:31.658730 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6975af2-c858-4890-b2f4-448a24dcd97b None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:31.695669 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e4447-75a6-45be-b5bd-3f485303a0c7 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:31.709306 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:31.783824 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6975af2-c858-4890-b2f4-448a24dcd97b None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:31.815667 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e4447-75a6-45be-b5bd-3f485303a0c7 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:31.821791 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b642b6-02a8-4ef3-9506-597e67878956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:31.822708 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b642b6-02a8-4ef3-9506-597e67878956 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:31.823171 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b642b6-02a8-4ef3-9506-597e67878956 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:31.823582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b642b6-02a8-4ef3-9506-597e67878956 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:31.824262 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b642b6-02a8-4ef3-9506-597e67878956 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:31.824557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b642b6-02a8-4ef3-9506-597e67878956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:31.826016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b642b6-02a8-4ef3-9506-597e67878956 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:31.834805 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 95/188] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:31.835518 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b642b6-02a8-4ef3-9506-597e67878956 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:31.858407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f7a4b-ed8e-4fe8-8ff3-3b6bd3006c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:31.859039 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f7a4b-ed8e-4fe8-8ff3-3b6bd3006c06 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:31.859880 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f7a4b-ed8e-4fe8-8ff3-3b6bd3006c06 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:31.859880 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f7a4b-ed8e-4fe8-8ff3-3b6bd3006c06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:31.866693 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:31.872918 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f7a4b-ed8e-4fe8-8ff3-3b6bd3006c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:31.879640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-117f7a4b-ed8e-4fe8-8ff3-3b6bd3006c06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:10:31.879640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:31.879640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:31.879640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:31.879640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:31.879640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:31.879640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:31.879640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:31.879640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:31.879640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:31.879640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:31.879640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:31.879640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:31.879640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:31.879640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:31.879640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:31.880569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:31.880569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:31.880569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:31.880569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:31.880569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:31.880569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:31.880569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:31.880569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:31.880569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:31.880569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:31.880569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:31.880569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:31.880569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:31.880569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:31.880569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:31.880569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:31.882055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:31.882055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:31.882055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:31.882055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:31.882055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:31.882055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:31.882055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:31.882055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:31.882055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:31.882055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:31.882055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:10:31.882055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:31.882055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 94/189] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:10:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:10:31.882055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f7a4b-ed8e-4fe8-8ff3-3b6bd3006c06 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:31.955433 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:31.961400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b642b6-02a8-4ef3-9506-597e67878956 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:31.993296 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f7a4b-ed8e-4fe8-8ff3-3b6bd3006c06 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:31.996001 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b651ce-1e23-4b91-8553-231a725e254c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:31.996622 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b651ce-1e23-4b91-8553-231a725e254c None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:31.996925 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b651ce-1e23-4b91-8553-231a725e254c None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:31.997196 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b651ce-1e23-4b91-8553-231a725e254c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:31.998313 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b651ce-1e23-4b91-8553-231a725e254c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:31.999779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b651ce-1e23-4b91-8553-231a725e254c None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:32.001377 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 96/190] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:10:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:32.002145 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b651ce-1e23-4b91-8553-231a725e254c None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:32.035414 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375fb47-99c6-4773-8782-d343f9c7af69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:32.036362 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375fb47-99c6-4773-8782-d343f9c7af69 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:32.036819 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375fb47-99c6-4773-8782-d343f9c7af69 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:32.037303 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375fb47-99c6-4773-8782-d343f9c7af69 None admin] PATH_INFO: `/v3/users/e2e1763de56b43f7a10164b2deb43fda` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:32.052525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375fb47-99c6-4773-8782-d343f9c7af69 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e1763de56b43f7a10164b2deb43fda)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:32.054452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375fb47-99c6-4773-8782-d343f9c7af69 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:32.056563 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 95/191] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:31 2022] GET /identity/v3/users/e2e1763de56b43f7a10164b2deb43fda => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:32.057639 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375fb47-99c6-4773-8782-d343f9c7af69 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:32.103387 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:32.111246 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b651ce-1e23-4b91-8553-231a725e254c None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:32.146229 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d435a6e-b879-4a61-9af8-8ef26d062c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:32.146837 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435a6e-b879-4a61-9af8-8ef26d062c1f None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:32.147117 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435a6e-b879-4a61-9af8-8ef26d062c1f None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:32.147390 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d435a6e-b879-4a61-9af8-8ef26d062c1f None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:32.148048 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d435a6e-b879-4a61-9af8-8ef26d062c1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:32.148352 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d435a6e-b879-4a61-9af8-8ef26d062c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:32.149765 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d435a6e-b879-4a61-9af8-8ef26d062c1f None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:32.158659 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 97/192] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:10:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:32.158659 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d435a6e-b879-4a61-9af8-8ef26d062c1f None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:32.172755 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375fb47-99c6-4773-8782-d343f9c7af69 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:32.202979 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:32.213170 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752fa70-a599-447a-8ea8-9ddbf2c70413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:32.213784 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752fa70-a599-447a-8ea8-9ddbf2c70413 None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:32.214062 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752fa70-a599-447a-8ea8-9ddbf2c70413 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:32.214864 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752fa70-a599-447a-8ea8-9ddbf2c70413 None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:32.215517 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752fa70-a599-447a-8ea8-9ddbf2c70413 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:32.217003 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752fa70-a599-447a-8ea8-9ddbf2c70413 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:32.270208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d435a6e-b879-4a61-9af8-8ef26d062c1f None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:32.300271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 96/193] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Aug 19 01:10:32 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:10:32.301901 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752fa70-a599-447a-8ea8-9ddbf2c70413 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:32.319441 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213edcd0-78c9-4d6f-9fcb-64a5f09490d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:32.320382 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213edcd0-78c9-4d6f-9fcb-64a5f09490d7 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:32.320832 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213edcd0-78c9-4d6f-9fcb-64a5f09490d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:32.321119 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213edcd0-78c9-4d6f-9fcb-64a5f09490d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:32.359474 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:32.419873 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213edcd0-78c9-4d6f-9fcb-64a5f09490d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:32.422461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213edcd0-78c9-4d6f-9fcb-64a5f09490d7 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:32.435278 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752fa70-a599-447a-8ea8-9ddbf2c70413 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:32.475541 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b881b4-bbbd-4286-811f-067daf84ad55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:32.476192 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b881b4-bbbd-4286-811f-067daf84ad55 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:32.476473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b881b4-bbbd-4286-811f-067daf84ad55 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:32.476751 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b881b4-bbbd-4286-811f-067daf84ad55 None admin] PATH_INFO: `/v3/users/e2e1763de56b43f7a10164b2deb43fda` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:32.478089 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b881b4-bbbd-4286-811f-067daf84ad55 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e1763de56b43f7a10164b2deb43fda)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:32.479570 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b881b4-bbbd-4286-811f-067daf84ad55 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:32.481720 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 97/194] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:32 2022] GET /identity/v3/users/e2e1763de56b43f7a10164b2deb43fda => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:32.487290 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b881b4-bbbd-4286-811f-067daf84ad55 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:32.572036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:32.576872 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 98/195] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:32.579713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213edcd0-78c9-4d6f-9fcb-64a5f09490d7 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:32.635783 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b881b4-bbbd-4286-811f-067daf84ad55 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:32.665991 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:32.683824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a78047-c282-4e2e-ba57-02ab4509935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:32.684768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a78047-c282-4e2e-ba57-02ab4509935f None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:32.685073 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a78047-c282-4e2e-ba57-02ab4509935f None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:32.685350 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a78047-c282-4e2e-ba57-02ab4509935f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:32.723866 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213edcd0-78c9-4d6f-9fcb-64a5f09490d7 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:32.767526 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a78047-c282-4e2e-ba57-02ab4509935f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:32.769799 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a78047-c282-4e2e-ba57-02ab4509935f None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:32.771700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b994d-0191-4143-a4d2-12666cc8a240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:32.773714 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b994d-0191-4143-a4d2-12666cc8a240 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:32.773714 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b994d-0191-4143-a4d2-12666cc8a240 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:32.773714 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b994d-0191-4143-a4d2-12666cc8a240 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:32.774735 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b994d-0191-4143-a4d2-12666cc8a240 None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:32.776253 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b994d-0191-4143-a4d2-12666cc8a240 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:32.779238 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 99/196] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:32 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:32.780433 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00565b8d-8886-4cee-852c-78470941aa12 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:32.780718 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00565b8d-8886-4cee-852c-78470941aa12 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:32.781045 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00565b8d-8886-4cee-852c-78470941aa12 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:32.782247 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 100/197] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:32.788496 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00565b8d-8886-4cee-852c-78470941aa12 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:32.831247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:32.905872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 98/198] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 01:10:32.907616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c9d87-4050-4e3b-923e-d2d4815d0b0f None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:32.907905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c9d87-4050-4e3b-923e-d2d4815d0b0f None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:32.908176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c9d87-4050-4e3b-923e-d2d4815d0b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:32.920030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00565b8d-8886-4cee-852c-78470941aa12 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:32.931961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-b28c9d87-4050-4e3b-923e-d2d4815d0b0f None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:32.933738 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-b28c9d87-4050-4e3b-923e-d2d4815d0b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:32.954421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:32.966227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709d961-1b00-4b17-942a-63f66d6fd1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:32.967266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709d961-1b00-4b17-942a-63f66d6fd1a7 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:32.967646 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709d961-1b00-4b17-942a-63f66d6fd1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:32.968015 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709d961-1b00-4b17-942a-63f66d6fd1a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:32.969382 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709d961-1b00-4b17-942a-63f66d6fd1a7 None admin] RBAC: Adding query filter params (role.id=fda5389edef24d6baac46d87242d285b, scope.project.id=d5da12a5841547c28a9b31bce0ec15db, user.id=e2e1763de56b43f7a10164b2deb43fda) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:32.969936 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709d961-1b00-4b17-942a-63f66d6fd1a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:32.971743 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709d961-1b00-4b17-942a-63f66d6fd1a7 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:32.984654 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 101/199] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:32 2022] GET /identity/v3/role_assignments?user.id=e2e1763de56b43f7a10164b2deb43fda&scope.project.id=d5da12a5841547c28a9b31bce0ec15db&role.id=fda5389edef24d6baac46d87242d285b => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:32.986348 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709d961-1b00-4b17-942a-63f66d6fd1a7 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:33.046530 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 99/200] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:33.132838 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709d961-1b00-4b17-942a-63f66d6fd1a7 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:33.184307 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243004d-9f1f-456d-9ac5-8d6f1725d202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:33.184949 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243004d-9f1f-456d-9ac5-8d6f1725d202 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:33.185228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243004d-9f1f-456d-9ac5-8d6f1725d202 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:33.185496 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243004d-9f1f-456d-9ac5-8d6f1725d202 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:33.187124 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243004d-9f1f-456d-9ac5-8d6f1725d202 None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:33.188637 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243004d-9f1f-456d-9ac5-8d6f1725d202 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:33.190346 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 102/201] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:32 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:33.196735 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c9d87-4050-4e3b-923e-d2d4815d0b0f None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:33.283181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:33.303276 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c9d87-4050-4e3b-923e-d2d4815d0b0f None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:33.348412 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdb253-0a3f-4893-aecb-ff3bd5e2706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:33.349076 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdb253-0a3f-4893-aecb-ff3bd5e2706c None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:33.349353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdb253-0a3f-4893-aecb-ff3bd5e2706c None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:33.349620 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdb253-0a3f-4893-aecb-ff3bd5e2706c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:33.350341 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdb253-0a3f-4893-aecb-ff3bd5e2706c None admin] RBAC: Adding query filter params (role.id=63d0d2b4616248b3aa738ec590e2e4b3, scope.project.id=d5da12a5841547c28a9b31bce0ec15db, user.id=e2e1763de56b43f7a10164b2deb43fda) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:33.350642 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdb253-0a3f-4893-aecb-ff3bd5e2706c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:33.352131 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdb253-0a3f-4893-aecb-ff3bd5e2706c None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:33.360672 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 100/202] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:33 2022] GET /identity/v3/role_assignments?user.id=e2e1763de56b43f7a10164b2deb43fda&scope.project.id=d5da12a5841547c28a9b31bce0ec15db&role.id=63d0d2b4616248b3aa738ec590e2e4b3 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:33.436840 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243004d-9f1f-456d-9ac5-8d6f1725d202 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:33.523336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:33.591019 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243004d-9f1f-456d-9ac5-8d6f1725d202 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:33.635219 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9bb39-c40d-475f-80dc-8f4e5e276544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:33.636593 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9bb39-c40d-475f-80dc-8f4e5e276544 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:33.636878 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9bb39-c40d-475f-80dc-8f4e5e276544 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:33.637205 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9bb39-c40d-475f-80dc-8f4e5e276544 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:33.648159 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9bb39-c40d-475f-80dc-8f4e5e276544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:33.654259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-95c9bb39-c40d-475f-80dc-8f4e5e276544 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:33.654259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:33.654259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:33.654259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:33.654259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:33.654259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:33.654259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:33.654259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:33.654259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:33.654259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:33.654259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:33.654259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:33.654259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:33.654259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:33.654259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:33.654259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:33.655183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:33.655183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:33.655183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:33.655183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:33.655183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:33.655183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:33.655183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:33.655183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:33.655183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:33.655183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:33.655183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:33.655183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:33.655183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:33.655183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:33.655183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:33.655183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:33.655978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:33.655978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:33.655978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:33.655978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:33.655978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:33.655978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:33.655978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:33.655978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:33.655978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:33.655978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:33.655978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:33.655978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:33.660189 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 103/203] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:33.665952 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdb253-0a3f-4893-aecb-ff3bd5e2706c None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:33.832646 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdb253-0a3f-4893-aecb-ff3bd5e2706c None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:33.878778 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b02aab-b509-490e-95d7-601cc975fa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:33.879849 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b02aab-b509-490e-95d7-601cc975fa05 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:33.880318 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b02aab-b509-490e-95d7-601cc975fa05 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:33.880816 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b02aab-b509-490e-95d7-601cc975fa05 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:33.881734 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b02aab-b509-490e-95d7-601cc975fa05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:33.882226 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b02aab-b509-490e-95d7-601cc975fa05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:33.883809 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b02aab-b509-490e-95d7-601cc975fa05 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:33.896471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 101/204] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:33.902652 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9bb39-c40d-475f-80dc-8f4e5e276544 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:34.084973 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9bb39-c40d-475f-80dc-8f4e5e276544 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:34.112547 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:34.139278 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a7f52-6303-4623-bd6d-76bdb4daa36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:34.139929 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a7f52-6303-4623-bd6d-76bdb4daa36f None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:34.140209 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a7f52-6303-4623-bd6d-76bdb4daa36f None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:34.140485 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a7f52-6303-4623-bd6d-76bdb4daa36f None admin] PATH_INFO: `/v3/users/249e03b998c74221ab0a20db43acee08` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:34.142429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a7f52-6303-4623-bd6d-76bdb4daa36f None admin] RBAC: Authorizing `identity:get_user(user_id=249e03b998c74221ab0a20db43acee08)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:34.144052 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a7f52-6303-4623-bd6d-76bdb4daa36f None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:34.146068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 104/205] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:33 2022] GET /identity/v3/users/249e03b998c74221ab0a20db43acee08 => generated 289 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:34.151378 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b02aab-b509-490e-95d7-601cc975fa05 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:34.165832 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:34.316499 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b02aab-b509-490e-95d7-601cc975fa05 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:34.362454 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012fb6b-df2b-425e-b238-48a6876c19ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:34.363073 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012fb6b-df2b-425e-b238-48a6876c19ae None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:34.363350 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012fb6b-df2b-425e-b238-48a6876c19ae None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:34.363618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012fb6b-df2b-425e-b238-48a6876c19ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:34.450541 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012fb6b-df2b-425e-b238-48a6876c19ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:34.452024 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012fb6b-df2b-425e-b238-48a6876c19ae None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:34.461414 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:34.606151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 102/206] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:34.612205 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a7f52-6303-4623-bd6d-76bdb4daa36f None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:34.743157 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a7f52-6303-4623-bd6d-76bdb4daa36f None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:34.781178 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c9b48-7667-427e-b42e-6ada448da3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:34.781813 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c9b48-7667-427e-b42e-6ada448da3e7 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:34.782091 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c9b48-7667-427e-b42e-6ada448da3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:34.782361 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c9b48-7667-427e-b42e-6ada448da3e7 None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:34.783494 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c9b48-7667-427e-b42e-6ada448da3e7 None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:34.785062 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c9b48-7667-427e-b42e-6ada448da3e7 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:34.786885 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 105/207] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:34 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:34.793419 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012fb6b-df2b-425e-b238-48a6876c19ae None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:34.900611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012fb6b-df2b-425e-b238-48a6876c19ae None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:34.909760 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:34.939088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974193b3-75a6-4f70-b656-0a7a3d6f84db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:34.939696 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974193b3-75a6-4f70-b656-0a7a3d6f84db None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:34.939970 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974193b3-75a6-4f70-b656-0a7a3d6f84db None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:34.940238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974193b3-75a6-4f70-b656-0a7a3d6f84db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:34.941004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974193b3-75a6-4f70-b656-0a7a3d6f84db None admin] RBAC: Adding query filter params (role.id=a39067aef3054bfb828616339857085f, scope.project.id=926d0bea317c4b8a9c79dcb750be0c31, user.id=249e03b998c74221ab0a20db43acee08) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:34.941308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974193b3-75a6-4f70-b656-0a7a3d6f84db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:34.942768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974193b3-75a6-4f70-b656-0a7a3d6f84db None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:34.950563 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 103/208] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:34 2022] GET /identity/v3/role_assignments?user.id=249e03b998c74221ab0a20db43acee08&scope.project.id=926d0bea317c4b8a9c79dcb750be0c31&role.id=a39067aef3054bfb828616339857085f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:35.205777 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9c21a-609d-41d5-81da-a3a7bd7e63fe None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:35.206152 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9c21a-609d-41d5-81da-a3a7bd7e63fe None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:35.206349 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9c21a-609d-41d5-81da-a3a7bd7e63fe None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:35.208269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 106/209] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:35.213719 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e754c-354d-4e76-a73c-a694a5dbf488 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:35.214008 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e754c-354d-4e76-a73c-a694a5dbf488 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:35.214343 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e754c-354d-4e76-a73c-a694a5dbf488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:35.235199 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-491e754c-354d-4e76-a73c-a694a5dbf488 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:35.236404 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-491e754c-354d-4e76-a73c-a694a5dbf488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:35.311679 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 104/210] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:35.347547 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2d44c-aeeb-4642-8384-cbaf6b8f935a None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:35.347841 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2d44c-aeeb-4642-8384-cbaf6b8f935a None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:35.348096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2d44c-aeeb-4642-8384-cbaf6b8f935a None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:35.349625 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 107/211] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:35.358729 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64743bcf-9877-4a1a-8da3-b7c6733a9c6e None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:35.359022 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64743bcf-9877-4a1a-8da3-b7c6733a9c6e None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:35.359294 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64743bcf-9877-4a1a-8da3-b7c6733a9c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:35.378831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-64743bcf-9877-4a1a-8da3-b7c6733a9c6e None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:35.380013 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-64743bcf-9877-4a1a-8da3-b7c6733a9c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:35.453070 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 105/212] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:35.696620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2d44c-aeeb-4642-8384-cbaf6b8f935a None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:35.758498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:35.807446 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2d44c-aeeb-4642-8384-cbaf6b8f935a None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:35.809417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64743bcf-9877-4a1a-8da3-b7c6733a9c6e None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:35.842559 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:35.848445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba31ad-93d6-4e36-a85a-d71d5dc1705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:35.849121 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba31ad-93d6-4e36-a85a-d71d5dc1705e None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:35.849401 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba31ad-93d6-4e36-a85a-d71d5dc1705e None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:35.849668 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba31ad-93d6-4e36-a85a-d71d5dc1705e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:35.852753 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba31ad-93d6-4e36-a85a-d71d5dc1705e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:35.852753 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba31ad-93d6-4e36-a85a-d71d5dc1705e None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:35.856907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 108/213] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:10:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:35.856907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d75238-9b14-456b-badb-a47a6ad6e7f3 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:35.856907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d75238-9b14-456b-badb-a47a6ad6e7f3 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:35.856907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d75238-9b14-456b-badb-a47a6ad6e7f3 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:35.861472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 109/214] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:35.862644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eab99e-5aff-4a05-9d2e-e56462b00bb0 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:35.863032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eab99e-5aff-4a05-9d2e-e56462b00bb0 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:35.863203 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eab99e-5aff-4a05-9d2e-e56462b00bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:35.882149 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-19eab99e-5aff-4a05-9d2e-e56462b00bb0 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:35.883344 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-19eab99e-5aff-4a05-9d2e-e56462b00bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:35.924403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64743bcf-9877-4a1a-8da3-b7c6733a9c6e None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:35.958067 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 110/215] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:35.959271 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eab99e-5aff-4a05-9d2e-e56462b00bb0 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:35.970459 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000fa2a-2c33-44ca-bedf-3ca7645a3b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:35.971422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000fa2a-2c33-44ca-bedf-3ca7645a3b27 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:35.971904 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000fa2a-2c33-44ca-bedf-3ca7645a3b27 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:35.972800 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000fa2a-2c33-44ca-bedf-3ca7645a3b27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:35.988026 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000fa2a-2c33-44ca-bedf-3ca7645a3b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:35.995381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-0000fa2a-2c33-44ca-bedf-3ca7645a3b27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:35.995381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:35.995381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:35.995381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:35.995381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:35.995381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:35.995381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:35.995381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:35.995381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:35.995381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:35.995381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:35.995381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:35.995381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:35.995381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:35.995381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:35.995381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:35.996285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:35.996285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:35.996285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:35.996285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:35.996285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:35.996285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:35.996285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:35.996285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:35.996285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:35.996285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:35.996285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:35.996285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:35.996285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:35.996285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:35.996285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:35.996285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:35.997100 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:35.997100 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:35.997100 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:35.997100 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:35.997100 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:35.997100 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:35.997100 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:35.997100 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:35.997100 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:35.997100 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:35.997100 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:35.997100 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:36.002933 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 106/216] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:10:36.003850 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000fa2a-2c33-44ca-bedf-3ca7645a3b27 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:36.023804 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:36.087059 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eab99e-5aff-4a05-9d2e-e56462b00bb0 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:36.110032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:36.122617 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000fa2a-2c33-44ca-bedf-3ca7645a3b27 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:36.128575 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f98214-afb5-4fb1-81c7-5b1a726fd553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:36.129330 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f98214-afb5-4fb1-81c7-5b1a726fd553 None admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:36.129681 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f98214-afb5-4fb1-81c7-5b1a726fd553 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:36.129956 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f98214-afb5-4fb1-81c7-5b1a726fd553 None admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:36.130746 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f98214-afb5-4fb1-81c7-5b1a726fd553 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:36.132412 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f98214-afb5-4fb1-81c7-5b1a726fd553 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:36.164713 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebff60e-d0d6-4d73-a955-8884bd8c5a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:36.165716 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebff60e-d0d6-4d73-a955-8884bd8c5a6a None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:36.166159 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebff60e-d0d6-4d73-a955-8884bd8c5a6a None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:36.166576 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebff60e-d0d6-4d73-a955-8884bd8c5a6a None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:36.167440 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebff60e-d0d6-4d73-a955-8884bd8c5a6a None admin] RBAC: Adding query filter params (name=member) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:36.167957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebff60e-d0d6-4d73-a955-8884bd8c5a6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:36.169585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebff60e-d0d6-4d73-a955-8884bd8c5a6a None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:36.178576 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 107/217] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:36.184506 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebff60e-d0d6-4d73-a955-8884bd8c5a6a None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:36.235931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 111/218] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Aug 19 01:10:35 2022] POST /identity/v3/users => generated 297 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:10:36.266334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953e4ce-be03-4d9d-b158-4bb2f4ff728a None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:36.266658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953e4ce-be03-4d9d-b158-4bb2f4ff728a None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:36.266880 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953e4ce-be03-4d9d-b158-4bb2f4ff728a None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:36.268393 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 112/219] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:10:36.274144 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e7970-c398-4cd8-b2e5-b8ed05dc24ec None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:36.274427 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e7970-c398-4cd8-b2e5-b8ed05dc24ec None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:36.274686 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e7970-c398-4cd8-b2e5-b8ed05dc24ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:36.294191 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-8c6e7970-c398-4cd8-b2e5-b8ed05dc24ec None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:36.295415 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-8c6e7970-c398-4cd8-b2e5-b8ed05dc24ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:36.307025 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebff60e-d0d6-4d73-a955-8884bd8c5a6a None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:36.356838 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981cc3-6c5c-438a-847a-e5f518de59a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:36.358462 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981cc3-6c5c-438a-847a-e5f518de59a4 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:36.359018 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981cc3-6c5c-438a-847a-e5f518de59a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:36.359784 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981cc3-6c5c-438a-847a-e5f518de59a4 None admin] PATH_INFO: `/v3/users/5f0c97e19ba542688aec917c4138d965` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:36.374493 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 113/220] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:36.375358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e7970-c398-4cd8-b2e5-b8ed05dc24ec None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:36.382050 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17981cc3-6c5c-438a-847a-e5f518de59a4 None admin] RBAC: Authorizing `identity:get_user(user_id=5f0c97e19ba542688aec917c4138d965)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:36.383885 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17981cc3-6c5c-438a-847a-e5f518de59a4 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:36.386865 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 108/221] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:36 2022] GET /identity/v3/users/5f0c97e19ba542688aec917c4138d965 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:36.392436 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981cc3-6c5c-438a-847a-e5f518de59a4 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:36.409126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:36.428204 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:36.501290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e7970-c398-4cd8-b2e5-b8ed05dc24ec None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:36.521287 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981cc3-6c5c-438a-847a-e5f518de59a4 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:36.552002 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9e411-6004-4e65-a752-328aa88deae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:36.553592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9e411-6004-4e65-a752-328aa88deae3 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:36.553592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9e411-6004-4e65-a752-328aa88deae3 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:36.553783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9e411-6004-4e65-a752-328aa88deae3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:36.567789 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9e411-6004-4e65-a752-328aa88deae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:36.575072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-76c9e411-6004-4e65-a752-328aa88deae3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:36.575072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:36.575072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:36.575072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:36.575072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:36.575072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:36.575072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:36.575072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:36.575072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:36.575072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:36.575072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:36.575072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:36.575072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:36.575072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:36.575072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:36.575072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:36.575953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:36.575953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:36.575953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:36.575953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:36.575953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:36.575953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:36.575953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:36.575953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:36.575953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:36.575953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:36.575953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:36.575953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:36.575953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:36.575953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:36.575953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:36.575953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:36.577505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:36.577505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:36.577505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:36.577505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:36.577505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:36.577505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:36.577505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:36.577505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:36.577505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:36.577505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:36.577505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:36.577505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:36.577505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 114/222] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:10:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:36.578155 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e5df0-dd72-496a-85b7-c81e80cfcfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:36.578155 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e5df0-dd72-496a-85b7-c81e80cfcfdd None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:36.578307 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e5df0-dd72-496a-85b7-c81e80cfcfdd None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:36.578650 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e5df0-dd72-496a-85b7-c81e80cfcfdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:36.582187 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9e411-6004-4e65-a752-328aa88deae3 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:36.676356 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e5df0-dd72-496a-85b7-c81e80cfcfdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:36.678137 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e5df0-dd72-496a-85b7-c81e80cfcfdd None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:36.692039 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:36.711091 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:36.714215 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9e411-6004-4e65-a752-328aa88deae3 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:36.757515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179b431-9031-4cdf-8535-a791c5b95fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:36.758137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b431-9031-4cdf-8535-a791c5b95fc8 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:36.758414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b431-9031-4cdf-8535-a791c5b95fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:36.758685 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b431-9031-4cdf-8535-a791c5b95fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:36.759372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179b431-9031-4cdf-8535-a791c5b95fc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:36.759657 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179b431-9031-4cdf-8535-a791c5b95fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:36.761243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179b431-9031-4cdf-8535-a791c5b95fc8 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:36.770426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 115/223] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:36.771632 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179b431-9031-4cdf-8535-a791c5b95fc8 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:36.806204 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 109/224] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:36.807552 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e5df0-dd72-496a-85b7-c81e80cfcfdd None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:36.922434 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179b431-9031-4cdf-8535-a791c5b95fc8 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:36.935372 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e5df0-dd72-496a-85b7-c81e80cfcfdd None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:36.951187 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:36.966719 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df32d6-3c40-4718-85e6-8a95da5c50d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:36.967694 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df32d6-3c40-4718-85e6-8a95da5c50d5 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:36.968196 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df32d6-3c40-4718-85e6-8a95da5c50d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:36.968661 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df32d6-3c40-4718-85e6-8a95da5c50d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:36.982278 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539b14a-056b-4adf-bec9-66f897b6aa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:36.982818 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df32d6-3c40-4718-85e6-8a95da5c50d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:36.982925 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539b14a-056b-4adf-bec9-66f897b6aa83 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:36.983180 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539b14a-056b-4adf-bec9-66f897b6aa83 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:36.983447 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539b14a-056b-4adf-bec9-66f897b6aa83 None admin] PATH_INFO: `/v3/users/e2e1763de56b43f7a10164b2deb43fda` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:36.984605 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539b14a-056b-4adf-bec9-66f897b6aa83 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e1763de56b43f7a10164b2deb43fda)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:36.986147 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539b14a-056b-4adf-bec9-66f897b6aa83 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:36.988159 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 110/225] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:36 2022] GET /identity/v3/users/e2e1763de56b43f7a10164b2deb43fda => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:36.988974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539b14a-056b-4adf-bec9-66f897b6aa83 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:36.990298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-62df32d6-3c40-4718-85e6-8a95da5c50d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:10:36.990298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:36.990298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:36.990298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:36.990298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:36.990298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:36.990298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:36.990298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:36.990298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:36.990298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:36.990298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:36.990298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:36.990298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:36.990298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:36.990298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:36.990298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:36.991179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:36.991179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:36.991179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:36.991179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:36.991179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:36.991179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:36.991179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:36.991179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:36.991179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:36.991179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:36.991179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:36.991179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:36.991179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:36.991179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:36.991179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:36.991179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:36.991977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:36.991977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:36.991977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:36.991977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:36.991977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:36.991977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:36.991977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:36.991977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:36.991977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:36.991977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:36.991977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:10:36.991977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:36.994528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 116/226] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:10:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:36.996127 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df32d6-3c40-4718-85e6-8a95da5c50d5 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:37.037250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:37.108799 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539b14a-056b-4adf-bec9-66f897b6aa83 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:37.132619 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df32d6-3c40-4718-85e6-8a95da5c50d5 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:37.154920 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b97ef-cf7c-46d2-b7fe-fee8a22b04bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:37.155887 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b97ef-cf7c-46d2-b7fe-fee8a22b04bb None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:37.156171 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b97ef-cf7c-46d2-b7fe-fee8a22b04bb None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:37.156454 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b97ef-cf7c-46d2-b7fe-fee8a22b04bb None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:37.157993 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b97ef-cf7c-46d2-b7fe-fee8a22b04bb None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:37.160223 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b97ef-cf7c-46d2-b7fe-fee8a22b04bb None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:37.162607 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 111/227] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:36 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:37.163362 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b97ef-cf7c-46d2-b7fe-fee8a22b04bb None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:37.176454 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb56496-3e87-4c50-be25-811c48019570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:37.177223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb56496-3e87-4c50-be25-811c48019570 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:37.177516 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb56496-3e87-4c50-be25-811c48019570 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:37.177792 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb56496-3e87-4c50-be25-811c48019570 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:37.178959 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb56496-3e87-4c50-be25-811c48019570 None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:37.180517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb56496-3e87-4c50-be25-811c48019570 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:37.187517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 117/228] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:36 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:37.188418 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb56496-3e87-4c50-be25-811c48019570 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:37.219294 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:37.278294 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b97ef-cf7c-46d2-b7fe-fee8a22b04bb None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:37.285866 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:37.299741 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb56496-3e87-4c50-be25-811c48019570 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:37.316354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9227c1-9462-4c18-88c4-4c6adeb6e5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:37.317229 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9227c1-9462-4c18-88c4-4c6adeb6e5bb None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:37.318212 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9227c1-9462-4c18-88c4-4c6adeb6e5bb None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:37.318722 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9227c1-9462-4c18-88c4-4c6adeb6e5bb None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:37.319578 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9227c1-9462-4c18-88c4-4c6adeb6e5bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:37.320023 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9227c1-9462-4c18-88c4-4c6adeb6e5bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:37.321590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9227c1-9462-4c18-88c4-4c6adeb6e5bb None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:37.330664 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 112/229] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:10:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:37.336387 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9227c1-9462-4c18-88c4-4c6adeb6e5bb None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:37.338353 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac5b2b-ca0c-42d2-bbff-9f2e404ea25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:37.338966 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac5b2b-ca0c-42d2-bbff-9f2e404ea25b None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:37.339946 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac5b2b-ca0c-42d2-bbff-9f2e404ea25b None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:37.340423 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac5b2b-ca0c-42d2-bbff-9f2e404ea25b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:37.341305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac5b2b-ca0c-42d2-bbff-9f2e404ea25b None admin] RBAC: Adding query filter params (role.id=f8c07e35d799437cbb53316acc2fc030, scope.project.id=d5da12a5841547c28a9b31bce0ec15db, user.id=5f0c97e19ba542688aec917c4138d965) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:37.341679 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac5b2b-ca0c-42d2-bbff-9f2e404ea25b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:37.343305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac5b2b-ca0c-42d2-bbff-9f2e404ea25b None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:37.349296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 118/230] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:37 2022] GET /identity/v3/role_assignments?user.id=5f0c97e19ba542688aec917c4138d965&scope.project.id=d5da12a5841547c28a9b31bce0ec15db&role.id=f8c07e35d799437cbb53316acc2fc030 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:37.356881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac5b2b-ca0c-42d2-bbff-9f2e404ea25b None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:37.465547 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac5b2b-ca0c-42d2-bbff-9f2e404ea25b None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:37.470580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9227c1-9462-4c18-88c4-4c6adeb6e5bb None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:37.482624 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:37.505458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe1131-e404-4967-ad98-b6e60af7491c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:37.506422 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe1131-e404-4967-ad98-b6e60af7491c None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:37.506912 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe1131-e404-4967-ad98-b6e60af7491c None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:37.507366 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe1131-e404-4967-ad98-b6e60af7491c None admin] PATH_INFO: `/v3/users/e2e1763de56b43f7a10164b2deb43fda` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:37.508773 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe1131-e404-4967-ad98-b6e60af7491c None admin] RBAC: Authorizing `identity:get_user(user_id=e2e1763de56b43f7a10164b2deb43fda)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:37.510515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe1131-e404-4967-ad98-b6e60af7491c None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:37.511000 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dcb10-10e0-4146-995d-0c02b1d52e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:37.512297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dcb10-10e0-4146-995d-0c02b1d52e43 None admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:37.512649 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dcb10-10e0-4146-995d-0c02b1d52e43 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:37.513023 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dcb10-10e0-4146-995d-0c02b1d52e43 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db/users/e2e1763de56b43f7a10164b2deb43fda/roles/fda5389edef24d6baac46d87242d285b` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:37.513773 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 119/231] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:37 2022] GET /identity/v3/users/e2e1763de56b43f7a10164b2deb43fda => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:37.519496 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe1131-e404-4967-ad98-b6e60af7491c None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:37.519759 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dcb10-10e0-4146-995d-0c02b1d52e43 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5da12a5841547c28a9b31bce0ec15db, user_id=e2e1763de56b43f7a10164b2deb43fda, role_id=fda5389edef24d6baac46d87242d285b)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:37.521584 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dcb10-10e0-4146-995d-0c02b1d52e43 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:37.546012 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:37.608181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 113/232] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Aug 19 01:10:37 2022] PUT /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db/users/e2e1763de56b43f7a10164b2deb43fda/roles/fda5389edef24d6baac46d87242d285b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:10:37.637964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe1131-e404-4967-ad98-b6e60af7491c None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:37.680570 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06f6b5-aa1f-4b06-80bb-033d7ee5bd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:37.681673 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06f6b5-aa1f-4b06-80bb-033d7ee5bd56 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:37.682157 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06f6b5-aa1f-4b06-80bb-033d7ee5bd56 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:37.682630 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06f6b5-aa1f-4b06-80bb-033d7ee5bd56 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:37.684837 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06f6b5-aa1f-4b06-80bb-033d7ee5bd56 None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:37.686588 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06f6b5-aa1f-4b06-80bb-033d7ee5bd56 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:37.688811 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 120/233] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:37 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:37.697406 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dcb10-10e0-4146-995d-0c02b1d52e43 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:37.818766 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dcb10-10e0-4146-995d-0c02b1d52e43 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:37.857434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7073d4-b54d-46c0-93cb-d34192757cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:37.858515 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7073d4-b54d-46c0-93cb-d34192757cd3 None admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:37.859065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7073d4-b54d-46c0-93cb-d34192757cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:37.859606 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7073d4-b54d-46c0-93cb-d34192757cd3 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db/users/e2e1763de56b43f7a10164b2deb43fda/roles/63d0d2b4616248b3aa738ec590e2e4b3` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:37.862108 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7073d4-b54d-46c0-93cb-d34192757cd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5da12a5841547c28a9b31bce0ec15db, user_id=e2e1763de56b43f7a10164b2deb43fda, role_id=63d0d2b4616248b3aa738ec590e2e4b3)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:37.863835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7073d4-b54d-46c0-93cb-d34192757cd3 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:37.935028 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 114/234] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Aug 19 01:10:37 2022] PUT /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db/users/e2e1763de56b43f7a10164b2deb43fda/roles/63d0d2b4616248b3aa738ec590e2e4b3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:10:38.970483 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f25524-6b6e-4097-9935-cf91766391f3 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:38.971004 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f25524-6b6e-4097-9935-cf91766391f3 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:38.971004 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f25524-6b6e-4097-9935-cf91766391f3 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:38.972514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 121/235] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:10:38.978627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30b52a-79fd-4d79-8df2-7ac8591b7311 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:38.979539 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30b52a-79fd-4d79-8df2-7ac8591b7311 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:38.980172 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30b52a-79fd-4d79-8df2-7ac8591b7311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:38.999167 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-1c30b52a-79fd-4d79-8df2-7ac8591b7311 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:39.000624 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-1c30b52a-79fd-4d79-8df2-7ac8591b7311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:39.039801 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:39.091391 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 115/236] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:39.115012 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd211c8-7970-4946-bd2b-bb3b97f412f3 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:39.115296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd211c8-7970-4946-bd2b-bb3b97f412f3 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:39.115572 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd211c8-7970-4946-bd2b-bb3b97f412f3 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:39.117210 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 122/237] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:39.122486 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae623e88-a11c-4bea-a423-58cd13906a2f None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:39.122777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae623e88-a11c-4bea-a423-58cd13906a2f None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:39.123054 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae623e88-a11c-4bea-a423-58cd13906a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:39.146570 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-ae623e88-a11c-4bea-a423-58cd13906a2f None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:39.147746 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-ae623e88-a11c-4bea-a423-58cd13906a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:39.236622 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 116/238] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:39.444996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd211c8-7970-4946-bd2b-bb3b97f412f3 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:39.560557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:39.574621 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd211c8-7970-4946-bd2b-bb3b97f412f3 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:39.608964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a0411-48ec-4530-a24e-db3335c7e1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:39.609595 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a0411-48ec-4530-a24e-db3335c7e1a7 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:39.609873 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a0411-48ec-4530-a24e-db3335c7e1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:39.610146 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a0411-48ec-4530-a24e-db3335c7e1a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:39.621236 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a0411-48ec-4530-a24e-db3335c7e1a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:39.626479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-744a0411-48ec-4530-a24e-db3335c7e1a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:39.626479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:39.626479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:39.626479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:39.626479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:39.626479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:39.626479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:39.626479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:39.626479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:39.626479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:39.626479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:39.626479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:39.626479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:39.626479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:39.626479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:39.626479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:39.627383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:39.627383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:39.627383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:39.627383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:39.627383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:39.627383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:39.627383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:39.627383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:39.627383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:39.627383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:39.627383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:39.627383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:39.627383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:39.627383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:39.627383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:39.627383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:39.628156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:39.628156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:39.628156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:39.628156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:39.628156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:39.628156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:39.628156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:39.628156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:39.628156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:39.628156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:39.628156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:39.628156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:39.634050 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 123/239] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:39.640055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae623e88-a11c-4bea-a423-58cd13906a2f None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:39.749595 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:39.762853 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae623e88-a11c-4bea-a423-58cd13906a2f None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:39.813465 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ada41-c59e-4eab-9f4f-47eab18f3633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:39.813997 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ada41-c59e-4eab-9f4f-47eab18f3633 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:39.814276 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ada41-c59e-4eab-9f4f-47eab18f3633 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:39.814549 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ada41-c59e-4eab-9f4f-47eab18f3633 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:39.815218 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ada41-c59e-4eab-9f4f-47eab18f3633 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:39.815517 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ada41-c59e-4eab-9f4f-47eab18f3633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:39.816932 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ada41-c59e-4eab-9f4f-47eab18f3633 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:39.828695 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 117/240] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:39.835719 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a0411-48ec-4530-a24e-db3335c7e1a7 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:39.901293 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ada41-c59e-4eab-9f4f-47eab18f3633 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:40.060665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a0411-48ec-4530-a24e-db3335c7e1a7 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:40.117292 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ada41-c59e-4eab-9f4f-47eab18f3633 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:40.129597 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2730bb1-8d16-4e24-a9a6-848668e815f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:40.130245 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2730bb1-8d16-4e24-a9a6-848668e815f9 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:40.130524 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2730bb1-8d16-4e24-a9a6-848668e815f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:40.130797 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2730bb1-8d16-4e24-a9a6-848668e815f9 None admin] PATH_INFO: `/v3/users/4f5f5a308f1f4a148dfc28ee0b40d304` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:40.164100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2730bb1-8d16-4e24-a9a6-848668e815f9 None admin] RBAC: Authorizing `identity:get_user(user_id=4f5f5a308f1f4a148dfc28ee0b40d304)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:40.166022 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2730bb1-8d16-4e24-a9a6-848668e815f9 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:40.169646 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e50a5-1f18-4f72-9d9e-f4eea516195f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:40.170290 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e50a5-1f18-4f72-9d9e-f4eea516195f None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:40.170567 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e50a5-1f18-4f72-9d9e-f4eea516195f None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:40.170836 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e50a5-1f18-4f72-9d9e-f4eea516195f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:40.172139 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e50a5-1f18-4f72-9d9e-f4eea516195f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:40.173722 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e50a5-1f18-4f72-9d9e-f4eea516195f None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:40.175370 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 124/241] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:39 2022] GET /identity/v3/users/4f5f5a308f1f4a148dfc28ee0b40d304 => generated 297 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:40.176241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2730bb1-8d16-4e24-a9a6-848668e815f9 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:40.176821 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 118/242] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:10:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:40.180407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e50a5-1f18-4f72-9d9e-f4eea516195f None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:40.188180 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:40.220986 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:40.366459 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e50a5-1f18-4f72-9d9e-f4eea516195f None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:40.396467 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2730bb1-8d16-4e24-a9a6-848668e815f9 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:40.408366 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfe0e2-443f-4980-b1fb-699fbd6729d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:40.409338 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfe0e2-443f-4980-b1fb-699fbd6729d1 None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:40.409903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfe0e2-443f-4980-b1fb-699fbd6729d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:40.410383 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfe0e2-443f-4980-b1fb-699fbd6729d1 None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:40.411317 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfe0e2-443f-4980-b1fb-699fbd6729d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:40.413091 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfe0e2-443f-4980-b1fb-699fbd6729d1 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:40.451358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd0d00-0835-4983-bea5-4e92fd40b445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:40.452033 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd0d00-0835-4983-bea5-4e92fd40b445 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:40.452315 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd0d00-0835-4983-bea5-4e92fd40b445 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:40.452582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd0d00-0835-4983-bea5-4e92fd40b445 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:40.504210 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 119/243] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Aug 19 01:10:40 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:10:40.510586 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63c7e1-f59e-4a52-82e7-53177d2cd336 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:40.510895 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63c7e1-f59e-4a52-82e7-53177d2cd336 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:40.511198 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63c7e1-f59e-4a52-82e7-53177d2cd336 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:40.512662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 120/244] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:40.518689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1207cf-0d8e-4e7f-bdce-90dc9dd3dca2 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:40.519042 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1207cf-0d8e-4e7f-bdce-90dc9dd3dca2 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:40.519331 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1207cf-0d8e-4e7f-bdce-90dc9dd3dca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:40.529409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd0d00-0835-4983-bea5-4e92fd40b445 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:40.531064 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd0d00-0835-4983-bea5-4e92fd40b445 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:40.541245 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:40.576971 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-cb1207cf-0d8e-4e7f-bdce-90dc9dd3dca2 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:40.578203 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-cb1207cf-0d8e-4e7f-bdce-90dc9dd3dca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:40.677098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 125/245] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:40.677098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f8d96-d35c-4097-a6d3-f8fb12409a09 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:40.677098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f8d96-d35c-4097-a6d3-f8fb12409a09 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:40.677098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f8d96-d35c-4097-a6d3-f8fb12409a09 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:40.677098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 126/246] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:40.680638 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f8d96-d35c-4097-a6d3-f8fb12409a09 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:40.686999 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 121/247] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:40.693976 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218301a-e106-4b41-980a-07f840b9f6a3 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:40.693976 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218301a-e106-4b41-980a-07f840b9f6a3 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:40.693976 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218301a-e106-4b41-980a-07f840b9f6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:40.707748 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:40.723607 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-8218301a-e106-4b41-980a-07f840b9f6a3 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:40.724807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-8218301a-e106-4b41-980a-07f840b9f6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:40.815505 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 122/248] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:40.817317 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fc2d5-9a61-4e3a-9ad7-b3699683bf76 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:40.818075 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fc2d5-9a61-4e3a-9ad7-b3699683bf76 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:40.818545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fc2d5-9a61-4e3a-9ad7-b3699683bf76 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:40.819987 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 123/249] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:40.828349 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884a1cc-3f84-4acc-a726-904d185e2980 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:40.828952 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884a1cc-3f84-4acc-a726-904d185e2980 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:40.829587 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884a1cc-3f84-4acc-a726-904d185e2980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:40.848350 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f8d96-d35c-4097-a6d3-f8fb12409a09 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:40.850472 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-d884a1cc-3f84-4acc-a726-904d185e2980 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:40.851980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-d884a1cc-3f84-4acc-a726-904d185e2980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:40.859013 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:40.897251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc4b8e-0207-4589-acf6-7658585440d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:40.897894 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc4b8e-0207-4589-acf6-7658585440d7 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:40.898173 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc4b8e-0207-4589-acf6-7658585440d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:40.898446 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc4b8e-0207-4589-acf6-7658585440d7 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:40.899600 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc4b8e-0207-4589-acf6-7658585440d7 None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:40.901799 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc4b8e-0207-4589-acf6-7658585440d7 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:40.904721 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 127/250] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:40 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:40.910039 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc4b8e-0207-4589-acf6-7658585440d7 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:40.949702 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 124/251] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:41.031571 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884a1cc-3f84-4acc-a726-904d185e2980 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:41.034872 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc4b8e-0207-4589-acf6-7658585440d7 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:41.086164 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5389d2-6d6e-4695-a5de-73407363e316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:41.086774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5389d2-6d6e-4695-a5de-73407363e316 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:41.087046 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5389d2-6d6e-4695-a5de-73407363e316 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:41.087320 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5389d2-6d6e-4695-a5de-73407363e316 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:41.088050 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5389d2-6d6e-4695-a5de-73407363e316 None admin] RBAC: Adding query filter params (role.id=a39067aef3054bfb828616339857085f, scope.project.id=d5da12a5841547c28a9b31bce0ec15db, user.id=4f5f5a308f1f4a148dfc28ee0b40d304) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:41.088357 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5389d2-6d6e-4695-a5de-73407363e316 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:41.090433 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5389d2-6d6e-4695-a5de-73407363e316 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:41.098236 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 128/252] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:40 2022] GET /identity/v3/role_assignments?user.id=4f5f5a308f1f4a148dfc28ee0b40d304&scope.project.id=d5da12a5841547c28a9b31bce0ec15db&role.id=a39067aef3054bfb828616339857085f => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:41.121324 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:41.170533 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884a1cc-3f84-4acc-a726-904d185e2980 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:41.217391 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc586b0-b8c0-4387-91ff-fe8e8edc5239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:41.218331 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc586b0-b8c0-4387-91ff-fe8e8edc5239 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:41.218755 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc586b0-b8c0-4387-91ff-fe8e8edc5239 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:41.219205 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc586b0-b8c0-4387-91ff-fe8e8edc5239 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:41.232338 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc586b0-b8c0-4387-91ff-fe8e8edc5239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:41.237688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-0bc586b0-b8c0-4387-91ff-fe8e8edc5239 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:41.237688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:41.237688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:41.237688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:41.237688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:41.237688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:41.237688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:41.237688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:41.237688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:41.237688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:41.237688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:41.237688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:41.237688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:41.237688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:41.237688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:41.237688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:41.238777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:41.238777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:41.238777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:41.238777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:41.238777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:41.238777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:41.238777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:41.238777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:41.238777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:41.238777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:41.238777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:41.238777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:41.238777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:41.238777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:41.238777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:41.238777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:41.239742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:41.239742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:41.239742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:41.239742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:41.239742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:41.239742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:41.239742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:41.239742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:41.239742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:41.239742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:41.239742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:41.239742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:41.242219 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 125/253] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:10:41.248427 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5389d2-6d6e-4695-a5de-73407363e316 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:41.319081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:41.335530 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc586b0-b8c0-4387-91ff-fe8e8edc5239 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:41.432020 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5389d2-6d6e-4695-a5de-73407363e316 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:41.493877 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429281d-0b15-4bda-92fe-a135de756596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:41.494833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429281d-0b15-4bda-92fe-a135de756596 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:41.495345 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429281d-0b15-4bda-92fe-a135de756596 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:41.496476 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429281d-0b15-4bda-92fe-a135de756596 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:41.497540 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429281d-0b15-4bda-92fe-a135de756596 None admin] RBAC: Adding query filter params (name=member) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:41.498047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429281d-0b15-4bda-92fe-a135de756596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:41.499713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429281d-0b15-4bda-92fe-a135de756596 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:41.509125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 129/254] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:41.510263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429281d-0b15-4bda-92fe-a135de756596 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:41.543018 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc586b0-b8c0-4387-91ff-fe8e8edc5239 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:41.601282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:41.622710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c7d06-d163-468e-8024-d2a938017dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:41.623365 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c7d06-d163-468e-8024-d2a938017dcf None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:41.623644 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c7d06-d163-468e-8024-d2a938017dcf None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:41.623914 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c7d06-d163-468e-8024-d2a938017dcf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:41.645285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c7d06-d163-468e-8024-d2a938017dcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:41.651806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-722c7d06-d163-468e-8024-d2a938017dcf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:10:41.651806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:41.651806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:41.651806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:41.651806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:41.651806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:41.651806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:41.651806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:41.651806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:41.651806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:41.651806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:41.651806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:41.651806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:41.651806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:41.651806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:41.651806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:41.652689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:41.652689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:41.652689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:41.652689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:41.652689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:41.652689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:41.652689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:41.652689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:41.652689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:41.652689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:41.652689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:41.652689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:41.652689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:41.652689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:41.652689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:41.652689 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:41.653532 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:41.653532 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:41.653532 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:41.653532 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:41.653532 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:41.653532 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:41.653532 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:41.653532 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:41.653532 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:41.653532 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:41.653532 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:10:41.653532 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:41.654146 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 126/255] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:10:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:41.654964 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c7d06-d163-468e-8024-d2a938017dcf None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:41.681493 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429281d-0b15-4bda-92fe-a135de756596 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:41.685209 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:41.726526 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca8741-e6c8-4c7e-910a-00bbf077efaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:41.727269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca8741-e6c8-4c7e-910a-00bbf077efaa None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:41.728106 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca8741-e6c8-4c7e-910a-00bbf077efaa None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:41.728404 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca8741-e6c8-4c7e-910a-00bbf077efaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:41.749183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca8741-e6c8-4c7e-910a-00bbf077efaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:41.753988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-21ca8741-e6c8-4c7e-910a-00bbf077efaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:41.753988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:41.753988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:41.753988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:41.753988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:41.753988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:41.753988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:41.753988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:41.753988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:41.753988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:41.753988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:41.753988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:41.753988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:41.753988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:41.753988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:41.753988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:41.754848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:41.754848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:41.754848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:41.754848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:41.754848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:41.754848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:41.754848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:41.754848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:41.754848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:41.754848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:41.754848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:41.754848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:41.754848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:41.754848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:41.754848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:41.754848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:41.755833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:41.755833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:41.755833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:41.755833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:41.755833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:41.755833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:41.755833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:41.755833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:41.755833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:41.755833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:41.755833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:41.755833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:41.755833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 130/256] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:10:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:41.756470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca8741-e6c8-4c7e-910a-00bbf077efaa None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:41.888048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c7d06-d163-468e-8024-d2a938017dcf None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:41.955179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca8741-e6c8-4c7e-910a-00bbf077efaa None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:41.960179 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472599b-887c-4c6a-9216-34d0b52251e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:41.960817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472599b-887c-4c6a-9216-34d0b52251e4 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:41.961254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472599b-887c-4c6a-9216-34d0b52251e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:41.961653 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472599b-887c-4c6a-9216-34d0b52251e4 None admin] PATH_INFO: `/v3/users/5f0c97e19ba542688aec917c4138d965` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:41.964811 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472599b-887c-4c6a-9216-34d0b52251e4 None admin] RBAC: Authorizing `identity:get_user(user_id=5f0c97e19ba542688aec917c4138d965)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:41.966327 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472599b-887c-4c6a-9216-34d0b52251e4 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:41.968128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 127/257] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:41 2022] GET /identity/v3/users/5f0c97e19ba542688aec917c4138d965 => generated 297 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:41.968684 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472599b-887c-4c6a-9216-34d0b52251e4 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:42.027385 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321fef0-d9a8-41e9-9208-d754762056db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:42.029101 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321fef0-d9a8-41e9-9208-d754762056db None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:42.031413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321fef0-d9a8-41e9-9208-d754762056db None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:42.031818 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321fef0-d9a8-41e9-9208-d754762056db None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:42.032605 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321fef0-d9a8-41e9-9208-d754762056db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:42.033785 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321fef0-d9a8-41e9-9208-d754762056db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:42.035335 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321fef0-d9a8-41e9-9208-d754762056db None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:42.051758 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 131/258] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:10:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:42.053617 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321fef0-d9a8-41e9-9208-d754762056db None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:42.071037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:42.109211 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:42.151365 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472599b-887c-4c6a-9216-34d0b52251e4 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:42.213253 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4db0e-085b-4159-9edc-196954191e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:42.213892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4db0e-085b-4159-9edc-196954191e2e None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:42.214178 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4db0e-085b-4159-9edc-196954191e2e None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:42.215611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4db0e-085b-4159-9edc-196954191e2e None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:42.216302 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4db0e-085b-4159-9edc-196954191e2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:42.216609 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4db0e-085b-4159-9edc-196954191e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:42.220896 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4db0e-085b-4159-9edc-196954191e2e None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:42.228232 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 128/259] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:42.233825 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4db0e-085b-4159-9edc-196954191e2e None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:42.259914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321fef0-d9a8-41e9-9208-d754762056db None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:42.353616 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2580217-acb4-445d-b914-f95b585651b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:42.354559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2580217-acb4-445d-b914-f95b585651b5 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:42.355632 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2580217-acb4-445d-b914-f95b585651b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:42.356077 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2580217-acb4-445d-b914-f95b585651b5 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:42.356492 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4db0e-085b-4159-9edc-196954191e2e None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:42.362927 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2580217-acb4-445d-b914-f95b585651b5 None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:42.364612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2580217-acb4-445d-b914-f95b585651b5 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:42.366460 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 132/260] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:42 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:42.371483 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:42.372259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2580217-acb4-445d-b914-f95b585651b5 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:42.403710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3305ad0-73d4-409e-8d63-758ed3f1896b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:42.404675 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3305ad0-73d4-409e-8d63-758ed3f1896b None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:42.405156 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3305ad0-73d4-409e-8d63-758ed3f1896b None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:42.405609 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3305ad0-73d4-409e-8d63-758ed3f1896b None admin] PATH_INFO: `/v3/users/e2e1763de56b43f7a10164b2deb43fda` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:42.407124 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3305ad0-73d4-409e-8d63-758ed3f1896b None admin] RBAC: Authorizing `identity:get_user(user_id=e2e1763de56b43f7a10164b2deb43fda)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:42.408774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3305ad0-73d4-409e-8d63-758ed3f1896b None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:42.418009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 129/261] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:42 2022] GET /identity/v3/users/e2e1763de56b43f7a10164b2deb43fda => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:42.419690 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3305ad0-73d4-409e-8d63-758ed3f1896b None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:42.561074 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3305ad0-73d4-409e-8d63-758ed3f1896b None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:42.604660 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdb361-f7f7-4220-96cd-5f47c08482d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:42.606864 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdb361-f7f7-4220-96cd-5f47c08482d2 None admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:42.607366 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdb361-f7f7-4220-96cd-5f47c08482d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:42.607838 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdb361-f7f7-4220-96cd-5f47c08482d2 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db/users/5f0c97e19ba542688aec917c4138d965/roles/f8c07e35d799437cbb53316acc2fc030` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:42.610621 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:42.613036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdb361-f7f7-4220-96cd-5f47c08482d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5da12a5841547c28a9b31bce0ec15db, user_id=5f0c97e19ba542688aec917c4138d965, role_id=f8c07e35d799437cbb53316acc2fc030)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:42.615916 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdb361-f7f7-4220-96cd-5f47c08482d2 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:42.628590 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2580217-acb4-445d-b914-f95b585651b5 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:42.665932 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37365e-0f95-4839-9b2a-a8a5e1109af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:42.666914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37365e-0f95-4839-9b2a-a8a5e1109af2 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:42.668154 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37365e-0f95-4839-9b2a-a8a5e1109af2 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:42.668673 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37365e-0f95-4839-9b2a-a8a5e1109af2 None admin] PATH_INFO: `/v3/users/e2e1763de56b43f7a10164b2deb43fda` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:42.670069 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37365e-0f95-4839-9b2a-a8a5e1109af2 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e1763de56b43f7a10164b2deb43fda)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:42.671718 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37365e-0f95-4839-9b2a-a8a5e1109af2 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:42.673691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 133/262] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:42 2022] GET /identity/v3/users/e2e1763de56b43f7a10164b2deb43fda => generated 283 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:42.674651 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37365e-0f95-4839-9b2a-a8a5e1109af2 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:42.734552 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 130/263] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Aug 19 01:10:42 2022] PUT /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db/users/5f0c97e19ba542688aec917c4138d965/roles/f8c07e35d799437cbb53316acc2fc030 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:10:42.735251 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdb361-f7f7-4220-96cd-5f47c08482d2 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:42.788623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37365e-0f95-4839-9b2a-a8a5e1109af2 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:42.829184 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7aa689-5e22-4688-a665-47b5fbb35412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:42.830226 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7aa689-5e22-4688-a665-47b5fbb35412 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:42.830708 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7aa689-5e22-4688-a665-47b5fbb35412 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:42.831179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7aa689-5e22-4688-a665-47b5fbb35412 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:42.859279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:42.885249 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:42.909395 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7aa689-5e22-4688-a665-47b5fbb35412 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:42.911342 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7aa689-5e22-4688-a665-47b5fbb35412 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:43.026256 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 134/264] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:43.032819 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7aa689-5e22-4688-a665-47b5fbb35412 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:43.099323 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdb361-f7f7-4220-96cd-5f47c08482d2 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:43.100278 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:43.145953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7aa689-5e22-4688-a665-47b5fbb35412 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:43.164776 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e0d9f-1e9f-4fdd-b00c-5c75ec8e725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:43.165444 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e0d9f-1e9f-4fdd-b00c-5c75ec8e725b None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:43.165700 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e0d9f-1e9f-4fdd-b00c-5c75ec8e725b None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:43.165968 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e0d9f-1e9f-4fdd-b00c-5c75ec8e725b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:43.188318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e71ba1-e764-46fc-9990-47704667dc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:43.189384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71ba1-e764-46fc-9990-47704667dc3b None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:43.189864 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71ba1-e764-46fc-9990-47704667dc3b None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:43.190334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71ba1-e764-46fc-9990-47704667dc3b None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:43.191715 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e71ba1-e764-46fc-9990-47704667dc3b None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:43.193577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e71ba1-e764-46fc-9990-47704667dc3b None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:43.195757 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 135/265] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:43 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:43.203119 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e71ba1-e764-46fc-9990-47704667dc3b None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:43.312757 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e71ba1-e764-46fc-9990-47704667dc3b None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:43.342669 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:43.358295 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e122b69-30d5-42c0-b8d4-02881fb7e0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:43.359956 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e122b69-30d5-42c0-b8d4-02881fb7e0cb None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:43.361034 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e122b69-30d5-42c0-b8d4-02881fb7e0cb None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:43.361516 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e122b69-30d5-42c0-b8d4-02881fb7e0cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:43.362601 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e122b69-30d5-42c0-b8d4-02881fb7e0cb None admin] RBAC: Adding query filter params (role.id=63d0d2b4616248b3aa738ec590e2e4b3, scope.project.id=d5da12a5841547c28a9b31bce0ec15db, user.id=e2e1763de56b43f7a10164b2deb43fda) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:43.365477 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e122b69-30d5-42c0-b8d4-02881fb7e0cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:43.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e122b69-30d5-42c0-b8d4-02881fb7e0cb None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:43.376220 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e0d9f-1e9f-4fdd-b00c-5c75ec8e725b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:43.378615 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e0d9f-1e9f-4fdd-b00c-5c75ec8e725b None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:43.382776 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 136/266] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:43 2022] GET /identity/v3/role_assignments?user.id=e2e1763de56b43f7a10164b2deb43fda&scope.project.id=d5da12a5841547c28a9b31bce0ec15db&role.id=63d0d2b4616248b3aa738ec590e2e4b3 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:43.451084 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:43.538687 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 131/267] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 804 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:43.555109 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e122b69-30d5-42c0-b8d4-02881fb7e0cb None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:43.580543 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f54e3-71de-473e-88c1-a42b0855a49a None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:43.580900 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f54e3-71de-473e-88c1-a42b0855a49a None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:43.581130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f54e3-71de-473e-88c1-a42b0855a49a None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:43.583877 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 132/268] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:43.588358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22938d-a804-4d99-bcde-b4e98cef4d44 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:43.588645 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22938d-a804-4d99-bcde-b4e98cef4d44 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:43.589071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22938d-a804-4d99-bcde-b4e98cef4d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:43.621659 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-fb22938d-a804-4d99-bcde-b4e98cef4d44 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:43.622864 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-fb22938d-a804-4d99-bcde-b4e98cef4d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:43.753278 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e122b69-30d5-42c0-b8d4-02881fb7e0cb None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:43.767573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 133/269] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:43.769235 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67054313-0e6c-47c3-b640-fa89214305ad None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:43.769732 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67054313-0e6c-47c3-b640-fa89214305ad None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:43.770288 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67054313-0e6c-47c3-b640-fa89214305ad None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:43.775214 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 134/270] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:43.794924 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae990907-9528-4b86-a3ee-a22016fdfdba None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:43.795250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae990907-9528-4b86-a3ee-a22016fdfdba None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:43.795471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae990907-9528-4b86-a3ee-a22016fdfdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:43.818410 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b47a98-d964-4790-95df-e08098520a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:43.818410 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b47a98-d964-4790-95df-e08098520a58 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:43.818410 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b47a98-d964-4790-95df-e08098520a58 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:43.818410 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b47a98-d964-4790-95df-e08098520a58 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:43.819380 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b47a98-d964-4790-95df-e08098520a58 None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:43.820043 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-ae990907-9528-4b86-a3ee-a22016fdfdba None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:43.821077 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b47a98-d964-4790-95df-e08098520a58 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:43.821659 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-ae990907-9528-4b86-a3ee-a22016fdfdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:43.823164 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 137/271] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:43 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:43.829947 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b47a98-d964-4790-95df-e08098520a58 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:43.905366 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 135/272] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:43.940018 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:44.004714 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b47a98-d964-4790-95df-e08098520a58 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:44.046772 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575d14e-70a1-4478-bd5d-7a3ad148e3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:44.047386 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575d14e-70a1-4478-bd5d-7a3ad148e3ae None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:44.047667 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575d14e-70a1-4478-bd5d-7a3ad148e3ae None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:44.047949 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575d14e-70a1-4478-bd5d-7a3ad148e3ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:44.048670 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575d14e-70a1-4478-bd5d-7a3ad148e3ae None admin] RBAC: Adding query filter params (role.id=fda5389edef24d6baac46d87242d285b, scope.project.id=d5da12a5841547c28a9b31bce0ec15db, user.id=e2e1763de56b43f7a10164b2deb43fda) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:44.049003 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575d14e-70a1-4478-bd5d-7a3ad148e3ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:44.050460 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575d14e-70a1-4478-bd5d-7a3ad148e3ae None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:44.060985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 138/273] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:43 2022] GET /identity/v3/role_assignments?user.id=e2e1763de56b43f7a10164b2deb43fda&scope.project.id=d5da12a5841547c28a9b31bce0ec15db&role.id=fda5389edef24d6baac46d87242d285b => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:44.121096 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc0fee-1deb-4c39-a09c-de2430f63e10 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:44.121762 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc0fee-1deb-4c39-a09c-de2430f63e10 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:44.122245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc0fee-1deb-4c39-a09c-de2430f63e10 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:44.124201 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 136/274] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:44.129963 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81dab7-6bf7-4f49-95d9-e6a2a2e2adc8 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:44.130571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81dab7-6bf7-4f49-95d9-e6a2a2e2adc8 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:44.131046 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81dab7-6bf7-4f49-95d9-e6a2a2e2adc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:44.152372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-9c81dab7-6bf7-4f49-95d9-e6a2a2e2adc8 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:44.154541 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-9c81dab7-6bf7-4f49-95d9-e6a2a2e2adc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:44.240600 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 139/275] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:44.266485 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc0fee-1deb-4c39-a09c-de2430f63e10 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:44.270236 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:44.303720 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81dab7-6bf7-4f49-95d9-e6a2a2e2adc8 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:44.379907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:44.419036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc0fee-1deb-4c39-a09c-de2430f63e10 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:44.437336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81dab7-6bf7-4f49-95d9-e6a2a2e2adc8 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:44.471213 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1debc06-a346-4f69-a8a4-b72b5b9f9a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:44.472123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1debc06-a346-4f69-a8a4-b72b5b9f9a0d None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:44.472405 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1debc06-a346-4f69-a8a4-b72b5b9f9a0d None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:44.472677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1debc06-a346-4f69-a8a4-b72b5b9f9a0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:44.485885 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f52721-27af-43ee-ac05-9e83945458ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:44.486223 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1debc06-a346-4f69-a8a4-b72b5b9f9a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:44.486528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f52721-27af-43ee-ac05-9e83945458ee None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:44.486801 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f52721-27af-43ee-ac05-9e83945458ee None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:44.487064 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f52721-27af-43ee-ac05-9e83945458ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:44.488160 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f52721-27af-43ee-ac05-9e83945458ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:44.490976 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f52721-27af-43ee-ac05-9e83945458ee None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:44.491386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-f1debc06-a346-4f69-a8a4-b72b5b9f9a0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:44.491386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:44.491386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:44.491386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:44.491386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:44.491386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:44.491386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:44.491386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:44.491386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:44.491386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:44.491386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:44.491386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:44.491386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:44.491386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:44.491386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:44.491386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:44.492346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:44.492346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:44.492346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:44.492346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:44.492346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:44.492346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:44.492346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:44.492346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:44.492346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:44.492346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:44.492346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:44.492346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:44.492346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:44.492346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:44.492346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:44.492346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:44.493151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:44.493151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:44.493151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:44.493151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:44.493151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:44.493151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:44.493151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:44.493151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:44.493151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:44.493151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:44.493151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:44.493151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:44.493151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 137/277] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:44.494351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 140/277] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:10:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:44.498734 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1debc06-a346-4f69-a8a4-b72b5b9f9a0d None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:44.501255 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f52721-27af-43ee-ac05-9e83945458ee None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:44.583718 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:44.618728 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f52721-27af-43ee-ac05-9e83945458ee None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:44.640425 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1debc06-a346-4f69-a8a4-b72b5b9f9a0d None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:44.646229 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:44.665369 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edd4b4-2187-4e92-9f4a-3af608593bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:44.666023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edd4b4-2187-4e92-9f4a-3af608593bee None admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:44.666306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edd4b4-2187-4e92-9f4a-3af608593bee None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:44.666573 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edd4b4-2187-4e92-9f4a-3af608593bee None admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:44.667213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edd4b4-2187-4e92-9f4a-3af608593bee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:44.670008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edd4b4-2187-4e92-9f4a-3af608593bee None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:44.685804 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da0033-2583-4568-ba8c-0838568b3c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:44.686474 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da0033-2583-4568-ba8c-0838568b3c5d None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:44.688296 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da0033-2583-4568-ba8c-0838568b3c5d None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:44.688296 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da0033-2583-4568-ba8c-0838568b3c5d None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:44.688296 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da0033-2583-4568-ba8c-0838568b3c5d None admin] RBAC: Adding query filter params (name=member) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:44.688296 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da0033-2583-4568-ba8c-0838568b3c5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:44.689371 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da0033-2583-4568-ba8c-0838568b3c5d None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:44.698072 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 138/278] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:44.700134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da0033-2583-4568-ba8c-0838568b3c5d None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:44.740710 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 141/279] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Aug 19 01:10:44 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:10:44.741414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edd4b4-2187-4e92-9f4a-3af608593bee None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:44.834282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da0033-2583-4568-ba8c-0838568b3c5d None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:44.866121 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:44.883795 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d51b69-0c98-41a7-92a9-f26d73cad3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:44.884809 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d51b69-0c98-41a7-92a9-f26d73cad3d6 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:44.885287 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d51b69-0c98-41a7-92a9-f26d73cad3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:44.885977 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d51b69-0c98-41a7-92a9-f26d73cad3d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:44.893614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edd4b4-2187-4e92-9f4a-3af608593bee None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:44.903578 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d51b69-0c98-41a7-92a9-f26d73cad3d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:44.911126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-28d51b69-0c98-41a7-92a9-f26d73cad3d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:44.911126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:44.911126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:44.911126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:44.911126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:44.911126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:44.911126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:44.911126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:44.911126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:44.911126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:44.911126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:44.911126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:44.911126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:44.911126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:44.911126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:44.911126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:44.912238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:44.912238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:44.912238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:44.912238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:44.912238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:44.912238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:44.912238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:44.912238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:44.912238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:44.912238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:44.912238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:44.912238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:44.912238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:44.912238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:44.912238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:44.912238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:44.913196 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:44.913196 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:44.913196 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:44.913196 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:44.913196 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:44.913196 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:44.913196 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:44.913196 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:44.913196 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:44.913196 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:44.913196 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:44.913196 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:44.914260 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 139/280] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:44.920928 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d51b69-0c98-41a7-92a9-f26d73cad3d6 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:44.946613 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015063cf-9c1a-462d-a791-3516c721b6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:44.948147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015063cf-9c1a-462d-a791-3516c721b6d4 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:44.948431 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015063cf-9c1a-462d-a791-3516c721b6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:44.949314 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015063cf-9c1a-462d-a791-3516c721b6d4 None admin] PATH_INFO: `/v3/users/356a2916d56d493a86e3501b8c7a75f6` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:44.966144 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015063cf-9c1a-462d-a791-3516c721b6d4 None admin] RBAC: Authorizing `identity:get_user(user_id=356a2916d56d493a86e3501b8c7a75f6)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:44.967614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015063cf-9c1a-462d-a791-3516c721b6d4 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:44.970889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 142/281] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:44 2022] GET /identity/v3/users/356a2916d56d493a86e3501b8c7a75f6 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:44.977188 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015063cf-9c1a-462d-a791-3516c721b6d4 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:45.026245 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:45.058581 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d51b69-0c98-41a7-92a9-f26d73cad3d6 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:45.103836 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca26bf2-d364-452b-bb27-7faca913cabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:45.104490 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca26bf2-d364-452b-bb27-7faca913cabb None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:45.104834 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca26bf2-d364-452b-bb27-7faca913cabb None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:45.105152 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca26bf2-d364-452b-bb27-7faca913cabb None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:45.105780 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca26bf2-d364-452b-bb27-7faca913cabb None admin] RBAC: Adding query filter params (name=reader) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:45.106082 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca26bf2-d364-452b-bb27-7faca913cabb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:45.107586 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca26bf2-d364-452b-bb27-7faca913cabb None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:45.122206 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 140/282] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:45.129444 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca26bf2-d364-452b-bb27-7faca913cabb None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:45.133360 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015063cf-9c1a-462d-a791-3516c721b6d4 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:45.173506 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee996d6-788e-463c-ba76-66ca32887714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:45.174883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee996d6-788e-463c-ba76-66ca32887714 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:45.175168 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee996d6-788e-463c-ba76-66ca32887714 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:45.175443 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee996d6-788e-463c-ba76-66ca32887714 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:45.176172 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee996d6-788e-463c-ba76-66ca32887714 None admin] RBAC: Adding query filter params (role.id=f8c07e35d799437cbb53316acc2fc030, user.id=356a2916d56d493a86e3501b8c7a75f6, scope.system=all) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:45.176482 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee996d6-788e-463c-ba76-66ca32887714 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:45.177977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee996d6-788e-463c-ba76-66ca32887714 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:45.183882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 143/283] 10.222.0.82 () {56 vars in 1308 bytes} [Fri Aug 19 01:10:44 2022] GET /identity/v3/role_assignments?user.id=356a2916d56d493a86e3501b8c7a75f6&scope.system=all&role.id=f8c07e35d799437cbb53316acc2fc030 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:45.191309 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:45.264317 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca26bf2-d364-452b-bb27-7faca913cabb None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:45.312825 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5ca0a-9a3d-462f-9804-f8eb135c5f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:45.313622 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5ca0a-9a3d-462f-9804-f8eb135c5f65 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:45.313787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5ca0a-9a3d-462f-9804-f8eb135c5f65 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:45.314053 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5ca0a-9a3d-462f-9804-f8eb135c5f65 None admin] PATH_INFO: `/v3/users/4f5f5a308f1f4a148dfc28ee0b40d304` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:45.315269 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5ca0a-9a3d-462f-9804-f8eb135c5f65 None admin] RBAC: Authorizing `identity:get_user(user_id=4f5f5a308f1f4a148dfc28ee0b40d304)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:45.316747 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5ca0a-9a3d-462f-9804-f8eb135c5f65 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:45.318408 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 141/284] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:45 2022] GET /identity/v3/users/4f5f5a308f1f4a148dfc28ee0b40d304 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:45.324223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee996d6-788e-463c-ba76-66ca32887714 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:45.451157 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee996d6-788e-463c-ba76-66ca32887714 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:45.453865 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:45.493757 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828951f-176b-43fb-98fb-92d2afadeb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:45.495080 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828951f-176b-43fb-98fb-92d2afadeb78 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:45.496348 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828951f-176b-43fb-98fb-92d2afadeb78 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:45.496604 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828951f-176b-43fb-98fb-92d2afadeb78 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:45.497823 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828951f-176b-43fb-98fb-92d2afadeb78 None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:45.499687 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828951f-176b-43fb-98fb-92d2afadeb78 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:45.502094 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 144/285] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:45 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:45.507737 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5ca0a-9a3d-462f-9804-f8eb135c5f65 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:45.657991 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5ca0a-9a3d-462f-9804-f8eb135c5f65 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:45.680717 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:45.710677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cca12-316c-4b3b-8592-5403bf791494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:45.711734 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cca12-316c-4b3b-8592-5403bf791494 None admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:45.712369 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cca12-316c-4b3b-8592-5403bf791494 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:45.712880 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cca12-316c-4b3b-8592-5403bf791494 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db/users/4f5f5a308f1f4a148dfc28ee0b40d304/roles/a39067aef3054bfb828616339857085f` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:45.715592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cca12-316c-4b3b-8592-5403bf791494 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5da12a5841547c28a9b31bce0ec15db, user_id=4f5f5a308f1f4a148dfc28ee0b40d304, role_id=a39067aef3054bfb828616339857085f)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:45.722398 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cca12-316c-4b3b-8592-5403bf791494 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:45.816872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 142/286] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Aug 19 01:10:45 2022] PUT /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db/users/4f5f5a308f1f4a148dfc28ee0b40d304/roles/a39067aef3054bfb828616339857085f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:10:46.135780 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3d0eb-84b6-4756-b1fd-a5a0e7b237ff None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:46.136200 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3d0eb-84b6-4756-b1fd-a5a0e7b237ff None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:46.136592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3d0eb-84b6-4756-b1fd-a5a0e7b237ff None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:46.138424 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 145/287] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:46.147649 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc48e59-0d5d-4d1b-b69f-21ad38882039 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:46.147928 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc48e59-0d5d-4d1b-b69f-21ad38882039 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:46.148198 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc48e59-0d5d-4d1b-b69f-21ad38882039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:46.169670 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-cbc48e59-0d5d-4d1b-b69f-21ad38882039 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:46.170853 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-cbc48e59-0d5d-4d1b-b69f-21ad38882039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:46.246288 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 143/288] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:46.636477 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3d0eb-84b6-4756-b1fd-a5a0e7b237ff None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:46.763497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3d0eb-84b6-4756-b1fd-a5a0e7b237ff None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:46.806860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a187d69-5b70-4710-92b1-6f8a15a1bf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:46.807411 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a187d69-5b70-4710-92b1-6f8a15a1bf7a None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:46.807690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a187d69-5b70-4710-92b1-6f8a15a1bf7a None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:46.808497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a187d69-5b70-4710-92b1-6f8a15a1bf7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:46.827301 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a187d69-5b70-4710-92b1-6f8a15a1bf7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:46.832104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-3a187d69-5b70-4710-92b1-6f8a15a1bf7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:46.832104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:46.832104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:46.832104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:46.832104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:46.832104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:46.832104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:46.832104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:46.832104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:46.832104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:46.832104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:46.832104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:46.832104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:46.832104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:46.832104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:46.832104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:46.833010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:46.833010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:46.833010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:46.833010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:46.833010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:46.833010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:46.833010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:46.833010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:46.833010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:46.833010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:46.833010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:46.833010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:46.833010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:46.833010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:46.833010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:46.833010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:46.833907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:46.833907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:46.833907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:46.833907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:46.833907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:46.833907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:46.833907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:46.833907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:46.833907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:46.833907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:46.833907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:46.833907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:46.833907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 146/289] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:46.839254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc48e59-0d5d-4d1b-b69f-21ad38882039 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:46.965053 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc48e59-0d5d-4d1b-b69f-21ad38882039 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:46.968718 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:47.014145 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3050368-3168-4642-8722-8c157013f1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:47.014756 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3050368-3168-4642-8722-8c157013f1ed None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:47.015027 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3050368-3168-4642-8722-8c157013f1ed None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:47.015289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3050368-3168-4642-8722-8c157013f1ed None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:47.015953 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3050368-3168-4642-8722-8c157013f1ed None admin] RBAC: Adding query filter params (name=member) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:47.016247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3050368-3168-4642-8722-8c157013f1ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:47.017640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3050368-3168-4642-8722-8c157013f1ed None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:47.032791 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 144/290] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:47.039482 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a187d69-5b70-4710-92b1-6f8a15a1bf7a None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:47.113268 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:47.208301 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a187d69-5b70-4710-92b1-6f8a15a1bf7a None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:47.256520 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a2ff5-7ae9-4107-9c70-0ab0f979812b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:47.257197 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a2ff5-7ae9-4107-9c70-0ab0f979812b None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:47.257477 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a2ff5-7ae9-4107-9c70-0ab0f979812b None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:47.257748 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a2ff5-7ae9-4107-9c70-0ab0f979812b None admin] PATH_INFO: `/v3/users/5f0c97e19ba542688aec917c4138d965` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:47.258958 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a2ff5-7ae9-4107-9c70-0ab0f979812b None admin] RBAC: Authorizing `identity:get_user(user_id=5f0c97e19ba542688aec917c4138d965)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:47.260425 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a2ff5-7ae9-4107-9c70-0ab0f979812b None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:47.262418 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 147/291] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:47 2022] GET /identity/v3/users/5f0c97e19ba542688aec917c4138d965 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:47.268096 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3050368-3168-4642-8722-8c157013f1ed None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:47.423569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3050368-3168-4642-8722-8c157013f1ed None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:47.470525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7e95b-5aa3-48a1-a569-5495ef19e43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:47.471489 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7e95b-5aa3-48a1-a569-5495ef19e43b None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:47.471988 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7e95b-5aa3-48a1-a569-5495ef19e43b None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:47.472454 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7e95b-5aa3-48a1-a569-5495ef19e43b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:47.527588 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:47.577189 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7e95b-5aa3-48a1-a569-5495ef19e43b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:47.578735 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7e95b-5aa3-48a1-a569-5495ef19e43b None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:47.694748 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32edf0-8d7f-485e-9dec-56fe162337e1 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:47.695250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32edf0-8d7f-485e-9dec-56fe162337e1 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:47.695250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32edf0-8d7f-485e-9dec-56fe162337e1 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:47.696685 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 148/292] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:10:47.703225 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328ffd-a75a-4de0-a9b7-22da7ae85acc None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:47.703779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328ffd-a75a-4de0-a9b7-22da7ae85acc None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:47.704266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328ffd-a75a-4de0-a9b7-22da7ae85acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:47.726011 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-ec328ffd-a75a-4de0-a9b7-22da7ae85acc None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:47.728552 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-ec328ffd-a75a-4de0-a9b7-22da7ae85acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:47.736012 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 145/293] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 01:10:47.741706 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7e95b-5aa3-48a1-a569-5495ef19e43b None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:47.816947 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 149/294] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:47.816947 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771fe20-6958-4173-9b49-ebdd2204a200 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:47.816947 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771fe20-6958-4173-9b49-ebdd2204a200 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:47.817430 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771fe20-6958-4173-9b49-ebdd2204a200 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:47.819022 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 150/295] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:47.824925 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6fc82-14de-46fc-a70c-4546ddf5b7e1 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:47.825214 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6fc82-14de-46fc-a70c-4546ddf5b7e1 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:47.825494 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6fc82-14de-46fc-a70c-4546ddf5b7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:47.845228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-f1d6fc82-14de-46fc-a70c-4546ddf5b7e1 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:47.846446 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-f1d6fc82-14de-46fc-a70c-4546ddf5b7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:47.867350 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:47.891922 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:47.936078 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 151/296] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:47.992942 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7e95b-5aa3-48a1-a569-5495ef19e43b None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:48.049734 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fce7ad-9fa2-4c04-b806-cee9f6bd8cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:48.050375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fce7ad-9fa2-4c04-b806-cee9f6bd8cdc None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:48.050668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fce7ad-9fa2-4c04-b806-cee9f6bd8cdc None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:48.050923 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fce7ad-9fa2-4c04-b806-cee9f6bd8cdc None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:48.052733 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fce7ad-9fa2-4c04-b806-cee9f6bd8cdc None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:48.054232 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fce7ad-9fa2-4c04-b806-cee9f6bd8cdc None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:48.055891 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 146/297] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:47 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:48.062141 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6fc82-14de-46fc-a70c-4546ddf5b7e1 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:48.168683 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5b65d-986f-464c-b27c-f1a3af47be1c None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:48.169086 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5b65d-986f-464c-b27c-f1a3af47be1c None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:48.169280 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5b65d-986f-464c-b27c-f1a3af47be1c None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:48.170941 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 147/298] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:48.178129 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a3098-2ff9-4531-8d3c-ae1ccf57a7a7 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:48.178462 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a3098-2ff9-4531-8d3c-ae1ccf57a7a7 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:48.178705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a3098-2ff9-4531-8d3c-ae1ccf57a7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:48.207092 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6fc82-14de-46fc-a70c-4546ddf5b7e1 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:48.217956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-564a3098-2ff9-4531-8d3c-ae1ccf57a7a7 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:48.219165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-564a3098-2ff9-4531-8d3c-ae1ccf57a7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:48.245277 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a8ae8-0b71-4402-896f-2a141040e564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:48.246312 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a8ae8-0b71-4402-896f-2a141040e564 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:48.246651 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a8ae8-0b71-4402-896f-2a141040e564 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:48.246914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a8ae8-0b71-4402-896f-2a141040e564 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:48.247702 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a8ae8-0b71-4402-896f-2a141040e564 None admin] RBAC: Adding query filter params (role.id=f8c07e35d799437cbb53316acc2fc030, scope.project.id=d5da12a5841547c28a9b31bce0ec15db, user.id=5f0c97e19ba542688aec917c4138d965) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:48.248407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a8ae8-0b71-4402-896f-2a141040e564 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:48.249882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a8ae8-0b71-4402-896f-2a141040e564 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:48.256262 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 152/299] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:48 2022] GET /identity/v3/role_assignments?user.id=5f0c97e19ba542688aec917c4138d965&scope.project.id=d5da12a5841547c28a9b31bce0ec15db&role.id=f8c07e35d799437cbb53316acc2fc030 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:48.273064 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a8ae8-0b71-4402-896f-2a141040e564 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:48.316951 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:48.380840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 148/300] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:48.462017 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a8ae8-0b71-4402-896f-2a141040e564 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:48.520357 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a6053-7820-415e-9bdf-0a7c10ba9d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:48.521210 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a6053-7820-415e-9bdf-0a7c10ba9d61 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:48.521493 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a6053-7820-415e-9bdf-0a7c10ba9d61 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:48.521769 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a6053-7820-415e-9bdf-0a7c10ba9d61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:48.522931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a6053-7820-415e-9bdf-0a7c10ba9d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:48.524350 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a6053-7820-415e-9bdf-0a7c10ba9d61 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:48.526251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 153/301] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:10:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:48.532344 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a3098-2ff9-4531-8d3c-ae1ccf57a7a7 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:48.561347 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a6053-7820-415e-9bdf-0a7c10ba9d61 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:48.613162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:48.671361 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:48.672086 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a3098-2ff9-4531-8d3c-ae1ccf57a7a7 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:48.689731 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a6053-7820-415e-9bdf-0a7c10ba9d61 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:48.722575 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2011308-b199-48a2-9eb1-9fd4c3a97ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:48.723483 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2011308-b199-48a2-9eb1-9fd4c3a97ad0 None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:48.723763 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2011308-b199-48a2-9eb1-9fd4c3a97ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:48.724037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2011308-b199-48a2-9eb1-9fd4c3a97ad0 None admin] PATH_INFO: `/v3/groups` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:48.724671 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2011308-b199-48a2-9eb1-9fd4c3a97ad0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:48.726394 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2011308-b199-48a2-9eb1-9fd4c3a97ad0 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:48.747251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267bc5-3bbe-4f81-874b-9d17e7a96d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:48.747923 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267bc5-3bbe-4f81-874b-9d17e7a96d2d None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:48.748356 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267bc5-3bbe-4f81-874b-9d17e7a96d2d None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:48.748644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267bc5-3bbe-4f81-874b-9d17e7a96d2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:48.764458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec267bc5-3bbe-4f81-874b-9d17e7a96d2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:48.771096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-ec267bc5-3bbe-4f81-874b-9d17e7a96d2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:48.771096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:48.771096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:48.771096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:48.771096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:48.771096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:48.771096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:48.771096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:48.771096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:48.771096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:48.771096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:48.771096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:48.771096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:48.771096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:48.771096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:48.771096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:48.771993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:48.771993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:48.771993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:48.771993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:48.771993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:48.771993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:48.771993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:48.771993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:48.771993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:48.771993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:48.771993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:48.771993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:48.771993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:48.771993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:48.771993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:48.771993 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:48.772783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:48.772783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:48.772783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:48.772783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:48.772783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:48.772783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:48.772783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:48.772783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:48.772783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:48.772783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:48.772783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:48.772783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:48.772783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 154/302] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:10:48.779677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267bc5-3bbe-4f81-874b-9d17e7a96d2d None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:48.812583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 149/303] 10.222.0.82 () {60 vars in 1134 bytes} [Fri Aug 19 01:10:48 2022] POST /identity/v3/groups => generated 229 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:10:48.813990 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2011308-b199-48a2-9eb1-9fd4c3a97ad0 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:48.919603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267bc5-3bbe-4f81-874b-9d17e7a96d2d None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:48.957948 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2011308-b199-48a2-9eb1-9fd4c3a97ad0 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:48.958621 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cae2c8-06e2-4abc-9a28-e26ee37a4912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:48.959304 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cae2c8-06e2-4abc-9a28-e26ee37a4912 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:48.959596 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cae2c8-06e2-4abc-9a28-e26ee37a4912 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:48.959865 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cae2c8-06e2-4abc-9a28-e26ee37a4912 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:48.960566 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cae2c8-06e2-4abc-9a28-e26ee37a4912 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:48.960885 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cae2c8-06e2-4abc-9a28-e26ee37a4912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:48.962320 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cae2c8-06e2-4abc-9a28-e26ee37a4912 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:48.972668 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 155/304] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:48.974007 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8332d4e-0c5e-48cd-9ea4-77b5eab1b05e None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:48.974300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8332d4e-0c5e-48cd-9ea4-77b5eab1b05e None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:48.974576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8332d4e-0c5e-48cd-9ea4-77b5eab1b05e None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:48.975978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 156/305] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:48.978796 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8332d4e-0c5e-48cd-9ea4-77b5eab1b05e None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:48.992457 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:48.997262 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:49.011899 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf964d-9b7f-49ff-8378-e49df45fda02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:49.012650 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf964d-9b7f-49ff-8378-e49df45fda02 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:49.012985 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf964d-9b7f-49ff-8378-e49df45fda02 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:49.013315 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf964d-9b7f-49ff-8378-e49df45fda02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:49.025791 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf964d-9b7f-49ff-8378-e49df45fda02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:49.032573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-e9cf964d-9b7f-49ff-8378-e49df45fda02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:49.032573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:49.032573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:49.032573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:49.032573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:49.032573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:49.032573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:49.032573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:49.032573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:49.032573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:49.032573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:49.032573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:49.032573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:49.032573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:49.032573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:49.032573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:49.033568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:49.033568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:49.033568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:49.033568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:49.033568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:49.033568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:49.033568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:49.033568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:49.033568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:49.033568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:49.033568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:49.033568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:49.033568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:49.033568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:49.033568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:49.033568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:49.034354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:49.034354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:49.034354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:49.034354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:49.034354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:49.034354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:49.034354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:49.034354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:49.034354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:49.034354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:49.034354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:49.034354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:49.034354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 150/306] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:49.035554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150b964-e567-4610-9251-48cfa62446b9 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:49.035736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150b964-e567-4610-9251-48cfa62446b9 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:49.035994 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150b964-e567-4610-9251-48cfa62446b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:49.056491 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-1150b964-e567-4610-9251-48cfa62446b9 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:49.057792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-1150b964-e567-4610-9251-48cfa62446b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:49.105688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8332d4e-0c5e-48cd-9ea4-77b5eab1b05e None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:49.134577 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 151/307] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:49.135450 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150b964-e567-4610-9251-48cfa62446b9 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:49.160945 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5d15b-1a57-4e16-8ed2-f1e88c86c9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:49.162227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5d15b-1a57-4e16-8ed2-f1e88c86c9f4 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:49.163145 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5d15b-1a57-4e16-8ed2-f1e88c86c9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:49.163631 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5d15b-1a57-4e16-8ed2-f1e88c86c9f4 None admin] PATH_INFO: `/v3/users/b5c33ad9c2e447d5a8a00bfaa5bdd98b` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:49.183483 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5d15b-1a57-4e16-8ed2-f1e88c86c9f4 None admin] RBAC: Authorizing `identity:get_user(user_id=b5c33ad9c2e447d5a8a00bfaa5bdd98b)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:49.186119 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5d15b-1a57-4e16-8ed2-f1e88c86c9f4 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:49.189304 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 157/308] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:48 2022] GET /identity/v3/users/b5c33ad9c2e447d5a8a00bfaa5bdd98b => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:49.200678 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5d15b-1a57-4e16-8ed2-f1e88c86c9f4 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:49.250907 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150b964-e567-4610-9251-48cfa62446b9 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:49.270361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:49.288663 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:49.298759 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c3802-54f1-4000-bbbc-9c150cf9e924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:49.299852 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c3802-54f1-4000-bbbc-9c150cf9e924 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:49.300317 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c3802-54f1-4000-bbbc-9c150cf9e924 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:49.301183 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c3802-54f1-4000-bbbc-9c150cf9e924 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:49.302015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c3802-54f1-4000-bbbc-9c150cf9e924 None admin] RBAC: Adding query filter params (name=member) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:49.302473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c3802-54f1-4000-bbbc-9c150cf9e924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:49.306828 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c3802-54f1-4000-bbbc-9c150cf9e924 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:49.316414 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 152/309] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:49.324816 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c3802-54f1-4000-bbbc-9c150cf9e924 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:49.332052 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5d15b-1a57-4e16-8ed2-f1e88c86c9f4 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:49.369883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84782a-35bc-45ff-8142-d01ed2afa361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:49.370689 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84782a-35bc-45ff-8142-d01ed2afa361 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:49.371203 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84782a-35bc-45ff-8142-d01ed2afa361 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:49.371697 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84782a-35bc-45ff-8142-d01ed2afa361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:49.372560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84782a-35bc-45ff-8142-d01ed2afa361 None admin] RBAC: Adding query filter params (role.id=a39067aef3054bfb828616339857085f, user.id=b5c33ad9c2e447d5a8a00bfaa5bdd98b, scope.system=all) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:49.372903 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84782a-35bc-45ff-8142-d01ed2afa361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:49.374370 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84782a-35bc-45ff-8142-d01ed2afa361 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:49.380070 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 158/310] 10.222.0.82 () {56 vars in 1308 bytes} [Fri Aug 19 01:10:49 2022] GET /identity/v3/role_assignments?user.id=b5c33ad9c2e447d5a8a00bfaa5bdd98b&scope.system=all&role.id=a39067aef3054bfb828616339857085f => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:49.440262 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c3802-54f1-4000-bbbc-9c150cf9e924 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:49.479780 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103b02b-73fb-425a-9f15-0c6bc13f5884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:49.480513 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b02b-73fb-425a-9f15-0c6bc13f5884 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:49.480792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b02b-73fb-425a-9f15-0c6bc13f5884 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:49.481172 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b02b-73fb-425a-9f15-0c6bc13f5884 None admin] PATH_INFO: `/v3/users/356a2916d56d493a86e3501b8c7a75f6` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:49.481272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84782a-35bc-45ff-8142-d01ed2afa361 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:49.482376 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103b02b-73fb-425a-9f15-0c6bc13f5884 None admin] RBAC: Authorizing `identity:get_user(user_id=356a2916d56d493a86e3501b8c7a75f6)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:49.483859 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103b02b-73fb-425a-9f15-0c6bc13f5884 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:49.485779 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 153/311] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:49 2022] GET /identity/v3/users/356a2916d56d493a86e3501b8c7a75f6 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:49.494741 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103b02b-73fb-425a-9f15-0c6bc13f5884 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:49.566033 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:49.608234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84782a-35bc-45ff-8142-d01ed2afa361 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:49.637270 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103b02b-73fb-425a-9f15-0c6bc13f5884 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:49.644641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:49.651803 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ad087-2997-440d-a111-e508116144ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:49.652747 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ad087-2997-440d-a111-e508116144ba None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:49.653062 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ad087-2997-440d-a111-e508116144ba None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:49.653420 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ad087-2997-440d-a111-e508116144ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:49.666156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ad087-2997-440d-a111-e508116144ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:49.673199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-4e4ad087-2997-440d-a111-e508116144ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:49.673199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:49.673199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:49.673199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:49.673199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:49.673199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:49.673199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:49.673199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:49.673199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:49.673199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:49.673199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:49.673199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:49.673199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:49.673199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:49.673199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:49.673199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:49.674136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:49.674136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:49.674136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:49.674136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:49.674136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:49.674136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:49.674136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:49.674136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:49.674136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:49.674136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:49.674136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:49.674136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:49.674136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:49.674136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:49.674136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:49.674136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:49.674940 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:49.674940 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:49.674940 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:49.674940 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:49.674940 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:49.674940 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:49.674940 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:49.674940 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:49.674940 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:49.674940 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:49.674940 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:49.674940 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:49.674940 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 159/312] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:49.681423 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ad087-2997-440d-a111-e508116144ba None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:49.685718 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9ec79-c5fa-4b23-9a57-1c3c50be81d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:49.686401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9ec79-c5fa-4b23-9a57-1c3c50be81d4 None admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:49.687340 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9ec79-c5fa-4b23-9a57-1c3c50be81d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:49.687340 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9ec79-c5fa-4b23-9a57-1c3c50be81d4 None admin] PATH_INFO: `/v3/system/users/356a2916d56d493a86e3501b8c7a75f6/roles/f8c07e35d799437cbb53316acc2fc030` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:49.688341 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9ec79-c5fa-4b23-9a57-1c3c50be81d4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=356a2916d56d493a86e3501b8c7a75f6, role_id=f8c07e35d799437cbb53316acc2fc030)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:49.689772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9ec79-c5fa-4b23-9a57-1c3c50be81d4 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:49.777146 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 154/313] 10.222.0.82 () {58 vars in 1334 bytes} [Fri Aug 19 01:10:49 2022] PUT /identity/v3/system/users/356a2916d56d493a86e3501b8c7a75f6/roles/f8c07e35d799437cbb53316acc2fc030 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:10:49.795337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ad087-2997-440d-a111-e508116144ba None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:49.838491 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845e425-513f-482d-af62-ec93b9e3d026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:49.840101 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845e425-513f-482d-af62-ec93b9e3d026 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:49.840566 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845e425-513f-482d-af62-ec93b9e3d026 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:49.841053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845e425-513f-482d-af62-ec93b9e3d026 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:49.841921 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845e425-513f-482d-af62-ec93b9e3d026 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:49.842401 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845e425-513f-482d-af62-ec93b9e3d026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:49.844130 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845e425-513f-482d-af62-ec93b9e3d026 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:49.854824 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 160/314] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:49.862433 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9ec79-c5fa-4b23-9a57-1c3c50be81d4 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:49.992115 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9ec79-c5fa-4b23-9a57-1c3c50be81d4 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:50.002365 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:50.028666 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88681f-c348-4781-9e3c-506ab0d33511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:50.029339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88681f-c348-4781-9e3c-506ab0d33511 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:50.029617 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88681f-c348-4781-9e3c-506ab0d33511 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:50.029948 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88681f-c348-4781-9e3c-506ab0d33511 None admin] PATH_INFO: `/v3/users/4f5f5a308f1f4a148dfc28ee0b40d304` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:50.031334 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88681f-c348-4781-9e3c-506ab0d33511 None admin] RBAC: Authorizing `identity:get_user(user_id=4f5f5a308f1f4a148dfc28ee0b40d304)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:50.033125 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88681f-c348-4781-9e3c-506ab0d33511 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:50.039772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 155/315] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:49 2022] GET /identity/v3/users/4f5f5a308f1f4a148dfc28ee0b40d304 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:50.041285 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845e425-513f-482d-af62-ec93b9e3d026 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:50.103946 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:50.155658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845e425-513f-482d-af62-ec93b9e3d026 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:50.193514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31ddac-7197-420a-bd77-80756c27b2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:50.194545 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31ddac-7197-420a-bd77-80756c27b2e4 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:50.195027 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31ddac-7197-420a-bd77-80756c27b2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:50.195498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31ddac-7197-420a-bd77-80756c27b2e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:50.267141 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31ddac-7197-420a-bd77-80756c27b2e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:50.268976 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31ddac-7197-420a-bd77-80756c27b2e4 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:50.322768 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:50.374084 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 161/316] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:50.379786 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88681f-c348-4781-9e3c-506ab0d33511 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:50.489823 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88681f-c348-4781-9e3c-506ab0d33511 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:50.525632 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b33de-abb5-44bc-8399-4c6b01f2d58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:50.526291 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b33de-abb5-44bc-8399-4c6b01f2d58d None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:50.526598 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b33de-abb5-44bc-8399-4c6b01f2d58d None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:50.526987 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b33de-abb5-44bc-8399-4c6b01f2d58d None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:50.528295 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b33de-abb5-44bc-8399-4c6b01f2d58d None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:50.529832 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b33de-abb5-44bc-8399-4c6b01f2d58d None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:50.531908 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 156/317] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:50 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:50.539961 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31ddac-7197-420a-bd77-80756c27b2e4 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:50.643668 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31ddac-7197-420a-bd77-80756c27b2e4 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:50.678792 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27778181-15d3-4bbc-bdb6-9bf873d2b095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:50.679407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27778181-15d3-4bbc-bdb6-9bf873d2b095 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:50.679687 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27778181-15d3-4bbc-bdb6-9bf873d2b095 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:50.679960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27778181-15d3-4bbc-bdb6-9bf873d2b095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:50.680683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27778181-15d3-4bbc-bdb6-9bf873d2b095 None admin] RBAC: Adding query filter params (role.id=a39067aef3054bfb828616339857085f, scope.project.id=d5da12a5841547c28a9b31bce0ec15db, user.id=4f5f5a308f1f4a148dfc28ee0b40d304) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:50.681028 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27778181-15d3-4bbc-bdb6-9bf873d2b095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:50.682479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27778181-15d3-4bbc-bdb6-9bf873d2b095 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:50.689368 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 162/318] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:10:50 2022] GET /identity/v3/role_assignments?user.id=4f5f5a308f1f4a148dfc28ee0b40d304&scope.project.id=d5da12a5841547c28a9b31bce0ec15db&role.id=a39067aef3054bfb828616339857085f => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:51.187604 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db34378-215b-4505-bd49-8c85579283f5 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:51.188122 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db34378-215b-4505-bd49-8c85579283f5 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:51.188122 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db34378-215b-4505-bd49-8c85579283f5 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:51.189524 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 157/319] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:51.194524 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaa2fc-2a7e-4cf8-a4d4-4b2fdf362ef4 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:51.194898 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaa2fc-2a7e-4cf8-a4d4-4b2fdf362ef4 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:51.195062 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eaa2fc-2a7e-4cf8-a4d4-4b2fdf362ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:51.213289 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-68eaa2fc-2a7e-4cf8-a4d4-4b2fdf362ef4 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:51.215084 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-68eaa2fc-2a7e-4cf8-a4d4-4b2fdf362ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:51.226018 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:51.281922 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 163/320] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:51.609052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db34378-215b-4505-bd49-8c85579283f5 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:51.633950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224ee59-17a9-4928-84a2-d275a177b72b None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:51.634246 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224ee59-17a9-4928-84a2-d275a177b72b None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:51.634501 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224ee59-17a9-4928-84a2-d275a177b72b None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:51.635844 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 164/321] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:10:51.640868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc7bc-571a-40ad-b92f-5b18dbfe68c3 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:51.641155 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc7bc-571a-40ad-b92f-5b18dbfe68c3 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:51.641435 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc7bc-571a-40ad-b92f-5b18dbfe68c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:51.658443 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:51.660084 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-611dc7bc-571a-40ad-b92f-5b18dbfe68c3 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:51.661371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-611dc7bc-571a-40ad-b92f-5b18dbfe68c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:51.717398 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db34378-215b-4505-bd49-8c85579283f5 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:51.731299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 165/322] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:51.753789 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc400e-d056-4e85-950d-e5d51d4465c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:51.754412 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc400e-d056-4e85-950d-e5d51d4465c4 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:51.754686 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc400e-d056-4e85-950d-e5d51d4465c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:51.754948 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc400e-d056-4e85-950d-e5d51d4465c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:51.756030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc400e-d056-4e85-950d-e5d51d4465c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:51.757510 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc400e-d056-4e85-950d-e5d51d4465c4 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:51.759199 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 158/323] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:10:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:51.764697 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dc7bc-571a-40ad-b92f-5b18dbfe68c3 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:51.840321 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:51.863176 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dc7bc-571a-40ad-b92f-5b18dbfe68c3 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:51.898137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0580bd-ae3b-48fa-b878-8f96255f1000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:51.898746 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0580bd-ae3b-48fa-b878-8f96255f1000 None admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:51.899022 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0580bd-ae3b-48fa-b878-8f96255f1000 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:51.899289 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0580bd-ae3b-48fa-b878-8f96255f1000 None admin] PATH_INFO: `/v3/groups` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:51.899987 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0580bd-ae3b-48fa-b878-8f96255f1000 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:51.901457 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0580bd-ae3b-48fa-b878-8f96255f1000 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:51.998707 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 166/324] 10.222.0.82 () {60 vars in 1134 bytes} [Fri Aug 19 01:10:51 2022] POST /identity/v3/groups => generated 226 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:10:52.058387 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc400e-d056-4e85-950d-e5d51d4465c4 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:52.142394 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b7f84-aef3-4c3e-9fcf-c113c306b7a5 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:52.142733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b7f84-aef3-4c3e-9fcf-c113c306b7a5 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:52.142959 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b7f84-aef3-4c3e-9fcf-c113c306b7a5 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:52.144529 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 167/325] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:10:52.150465 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed29e9d-fba0-48cf-8da8-d6ddd7340e4a None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:52.150750 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed29e9d-fba0-48cf-8da8-d6ddd7340e4a None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:52.151021 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed29e9d-fba0-48cf-8da8-d6ddd7340e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:52.170854 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-0ed29e9d-fba0-48cf-8da8-d6ddd7340e4a None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:52.172666 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-0ed29e9d-fba0-48cf-8da8-d6ddd7340e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:52.174309 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc400e-d056-4e85-950d-e5d51d4465c4 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:52.190373 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:52.215360 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4421c-b25d-43ec-a385-c96128df1992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:52.215999 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4421c-b25d-43ec-a385-c96128df1992 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:52.216277 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4421c-b25d-43ec-a385-c96128df1992 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:52.216996 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4421c-b25d-43ec-a385-c96128df1992 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:52.229123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4421c-b25d-43ec-a385-c96128df1992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:52.234511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-7af4421c-b25d-43ec-a385-c96128df1992 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:52.234511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:52.234511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:52.234511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:52.234511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:52.234511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:52.234511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:52.234511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:52.234511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:52.234511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:52.234511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:52.234511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:52.234511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:52.234511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:52.234511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:52.234511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:52.235417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:52.235417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:52.235417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:52.235417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:52.235417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:52.235417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:52.235417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:52.235417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:52.235417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:52.235417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:52.235417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:52.235417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:52.235417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:52.235417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:52.235417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:52.235417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:52.236470 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:52.236470 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:52.236470 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:52.236470 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:52.236470 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:52.236470 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:52.236470 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:52.236470 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:52.236470 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:52.236470 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:52.236470 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:52.236470 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:52.236470 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 159/326] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:52.241342 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4421c-b25d-43ec-a385-c96128df1992 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:52.261865 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 168/327] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:52.352886 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4421c-b25d-43ec-a385-c96128df1992 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:52.391098 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e1cba-798b-43f6-b6ea-d8e768221cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:52.391722 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e1cba-798b-43f6-b6ea-d8e768221cfa None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:52.392003 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e1cba-798b-43f6-b6ea-d8e768221cfa None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:52.392275 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e1cba-798b-43f6-b6ea-d8e768221cfa None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:52.393032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e1cba-798b-43f6-b6ea-d8e768221cfa None admin] RBAC: Adding query filter params (name=reader) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:52.393284 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e1cba-798b-43f6-b6ea-d8e768221cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:52.394833 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e1cba-798b-43f6-b6ea-d8e768221cfa None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:52.405526 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 160/328] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:52.410737 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed29e9d-fba0-48cf-8da8-d6ddd7340e4a None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:52.481216 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:52.526213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed29e9d-fba0-48cf-8da8-d6ddd7340e4a None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:52.564198 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a1a35-39df-4e58-9f49-8f56084b9e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:52.564837 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a1a35-39df-4e58-9f49-8f56084b9e19 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:52.565151 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a1a35-39df-4e58-9f49-8f56084b9e19 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:52.565421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a1a35-39df-4e58-9f49-8f56084b9e19 None admin] PATH_INFO: `/v3/users/b5c33ad9c2e447d5a8a00bfaa5bdd98b` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:52.566774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a1a35-39df-4e58-9f49-8f56084b9e19 None admin] RBAC: Authorizing `identity:get_user(user_id=b5c33ad9c2e447d5a8a00bfaa5bdd98b)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:52.568216 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a1a35-39df-4e58-9f49-8f56084b9e19 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:52.570195 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 169/329] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:52 2022] GET /identity/v3/users/b5c33ad9c2e447d5a8a00bfaa5bdd98b => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:52.576575 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e1cba-798b-43f6-b6ea-d8e768221cfa None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:52.617474 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a1a35-39df-4e58-9f49-8f56084b9e19 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:52.619817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:52.702396 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e1cba-798b-43f6-b6ea-d8e768221cfa None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:52.746203 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a1a35-39df-4e58-9f49-8f56084b9e19 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:52.753212 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b23de-a687-4d91-be4e-8cae2d5d01d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:52.754195 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b23de-a687-4d91-be4e-8cae2d5d01d7 None admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:52.755220 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b23de-a687-4d91-be4e-8cae2d5d01d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:52.755727 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b23de-a687-4d91-be4e-8cae2d5d01d7 None admin] PATH_INFO: `/v3/system/users/b5c33ad9c2e447d5a8a00bfaa5bdd98b/roles/a39067aef3054bfb828616339857085f` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:52.757894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b23de-a687-4d91-be4e-8cae2d5d01d7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b5c33ad9c2e447d5a8a00bfaa5bdd98b, role_id=a39067aef3054bfb828616339857085f)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:52.760322 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b23de-a687-4d91-be4e-8cae2d5d01d7 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:52.794694 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07fda1-3aff-47d7-8017-15b529091670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:52.795317 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07fda1-3aff-47d7-8017-15b529091670 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:52.795595 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07fda1-3aff-47d7-8017-15b529091670 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:52.795941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07fda1-3aff-47d7-8017-15b529091670 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:52.798171 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:52.808435 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07fda1-3aff-47d7-8017-15b529091670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:52.813609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-5d07fda1-3aff-47d7-8017-15b529091670 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:52.813609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:52.813609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:52.813609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:52.813609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:52.813609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:52.813609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:52.813609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:52.813609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:52.813609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:52.813609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:52.813609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:52.813609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:52.813609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:52.813609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:52.813609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:52.814497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:52.814497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:52.814497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:52.814497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:52.814497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:52.814497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:52.814497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:52.814497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:52.814497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:52.814497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:52.814497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:52.814497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:52.814497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:52.814497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:52.814497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:52.814497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:52.815291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:52.815291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:52.815291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:52.815291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:52.815291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:52.815291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:52.815291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:52.815291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:52.815291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:52.815291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:52.815291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:52.815291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:52.815291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 170/330] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:52.822304 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07fda1-3aff-47d7-8017-15b529091670 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:52.826851 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 161/331] 10.222.0.82 () {58 vars in 1334 bytes} [Fri Aug 19 01:10:52 2022] PUT /identity/v3/system/users/b5c33ad9c2e447d5a8a00bfaa5bdd98b/roles/a39067aef3054bfb828616339857085f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:10:52.945541 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07fda1-3aff-47d7-8017-15b529091670 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:52.990235 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbfb99-ac4d-48bc-ad50-0846f601e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:52.991309 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbfb99-ac4d-48bc-ad50-0846f601e199 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:52.991792 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbfb99-ac4d-48bc-ad50-0846f601e199 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:52.992276 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbfb99-ac4d-48bc-ad50-0846f601e199 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:52.993188 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbfb99-ac4d-48bc-ad50-0846f601e199 None admin] RBAC: Adding query filter params (name=member) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:52.993711 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbfb99-ac4d-48bc-ad50-0846f601e199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:52.995900 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbfb99-ac4d-48bc-ad50-0846f601e199 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:53.006156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 171/332] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:10:53.012915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b23de-a687-4d91-be4e-8cae2d5d01d7 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:53.123589 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:53.128013 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b23de-a687-4d91-be4e-8cae2d5d01d7 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:53.170894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ada794-2286-4d4c-b8a7-e0d94a87cf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:53.171544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ada794-2286-4d4c-b8a7-e0d94a87cf96 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:53.171826 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ada794-2286-4d4c-b8a7-e0d94a87cf96 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:53.172102 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ada794-2286-4d4c-b8a7-e0d94a87cf96 None admin] PATH_INFO: `/v3/users/356a2916d56d493a86e3501b8c7a75f6` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:53.173372 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ada794-2286-4d4c-b8a7-e0d94a87cf96 None admin] RBAC: Authorizing `identity:get_user(user_id=356a2916d56d493a86e3501b8c7a75f6)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:53.174884 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ada794-2286-4d4c-b8a7-e0d94a87cf96 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:53.176774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 162/333] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:53 2022] GET /identity/v3/users/356a2916d56d493a86e3501b8c7a75f6 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:53.183422 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbfb99-ac4d-48bc-ad50-0846f601e199 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:53.245385 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:53.291832 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbfb99-ac4d-48bc-ad50-0846f601e199 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:53.336493 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a3a3e-5547-4c28-9b58-22b10ea559a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:53.337128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a3a3e-5547-4c28-9b58-22b10ea559a7 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:53.337412 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a3a3e-5547-4c28-9b58-22b10ea559a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:53.337689 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a3a3e-5547-4c28-9b58-22b10ea559a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:53.338434 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a3a3e-5547-4c28-9b58-22b10ea559a7 None admin] RBAC: Adding query filter params (role.id=f8c07e35d799437cbb53316acc2fc030, user.id=356a2916d56d493a86e3501b8c7a75f6, scope.system=all) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:53.338746 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a3a3e-5547-4c28-9b58-22b10ea559a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:53.340843 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a3a3e-5547-4c28-9b58-22b10ea559a7 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:53.358130 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 172/334] 10.222.0.82 () {56 vars in 1308 bytes} [Fri Aug 19 01:10:53 2022] GET /identity/v3/role_assignments?user.id=356a2916d56d493a86e3501b8c7a75f6&scope.system=all&role.id=f8c07e35d799437cbb53316acc2fc030 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:55.040488 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b25af-9f35-485d-9b2d-2072a568ef6d None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:55.041058 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b25af-9f35-485d-9b2d-2072a568ef6d None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:55.041058 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b25af-9f35-485d-9b2d-2072a568ef6d None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:55.042727 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 163/335] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:55.048107 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96e586-934f-4602-ae83-dae3fe4e8583 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:55.049040 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96e586-934f-4602-ae83-dae3fe4e8583 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:55.049570 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96e586-934f-4602-ae83-dae3fe4e8583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:55.069547 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-8f96e586-934f-4602-ae83-dae3fe4e8583 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:55.071143 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-8f96e586-934f-4602-ae83-dae3fe4e8583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:55.164401 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 173/336] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:55.392032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e1a83-7081-414b-9749-a9b2f0db00a3 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:55.392426 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e1a83-7081-414b-9749-a9b2f0db00a3 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:55.392602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e1a83-7081-414b-9749-a9b2f0db00a3 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:55.394217 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 164/337] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:55.399901 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04096b-5d6f-438a-a4a2-0106151f61ad None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:55.400193 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04096b-5d6f-438a-a4a2-0106151f61ad None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:55.400473 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04096b-5d6f-438a-a4a2-0106151f61ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:55.421848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-1c04096b-5d6f-438a-a4a2-0106151f61ad None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:55.423049 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-1c04096b-5d6f-438a-a4a2-0106151f61ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:55.474911 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:55.502931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 174/338] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:55.632724 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e1a83-7081-414b-9749-a9b2f0db00a3 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:55.753717 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e1a83-7081-414b-9749-a9b2f0db00a3 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:55.800387 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd6d88-1cb9-4280-b0bd-c51f6323e43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:55.801087 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd6d88-1cb9-4280-b0bd-c51f6323e43a None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:55.801358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd6d88-1cb9-4280-b0bd-c51f6323e43a None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:55.801627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd6d88-1cb9-4280-b0bd-c51f6323e43a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:55.819281 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd6d88-1cb9-4280-b0bd-c51f6323e43a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:55.825020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-95cd6d88-1cb9-4280-b0bd-c51f6323e43a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:55.825020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:55.825020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:55.825020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:55.825020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:55.825020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:55.825020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:55.825020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:55.825020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:55.825020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:55.825020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:55.825020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:55.825020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:55.825020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:55.825020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:55.825020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:55.825930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:55.825930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:55.825930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:55.825930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:55.825930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:55.825930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:55.825930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:55.825930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:55.825930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:55.825930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:55.825930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:55.825930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:55.825930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:55.825930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:55.825930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:55.825930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:55.826721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:55.826721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:55.826721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:55.826721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:55.826721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:55.826721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:55.826721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:55.826721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:55.826721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:55.826721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:55.826721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:55.826721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:55.826721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 165/339] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:55.836801 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04096b-5d6f-438a-a4a2-0106151f61ad None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:55.969802 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04096b-5d6f-438a-a4a2-0106151f61ad None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:56.015638 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeef0a0-ec0a-4d36-9266-0383025a1bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:56.016180 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeef0a0-ec0a-4d36-9266-0383025a1bfb None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:56.016464 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeef0a0-ec0a-4d36-9266-0383025a1bfb None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:56.016737 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeef0a0-ec0a-4d36-9266-0383025a1bfb None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:56.017436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeef0a0-ec0a-4d36-9266-0383025a1bfb None admin] RBAC: Adding query filter params (name=member) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:56.017741 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeef0a0-ec0a-4d36-9266-0383025a1bfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:56.019127 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeef0a0-ec0a-4d36-9266-0383025a1bfb None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:56.029312 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 175/340] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:56.037211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd6d88-1cb9-4280-b0bd-c51f6323e43a None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:56.084194 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:56.108680 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c4e0d-f70d-4b75-87ef-26d626e8bf32 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:56.109356 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c4e0d-f70d-4b75-87ef-26d626e8bf32 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:56.109356 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c4e0d-f70d-4b75-87ef-26d626e8bf32 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:56.110640 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 176/341] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:56.123386 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7bac5-fe86-4f82-8804-326c00d5cc04 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:56.123666 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7bac5-fe86-4f82-8804-326c00d5cc04 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:56.124075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7bac5-fe86-4f82-8804-326c00d5cc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:56.152211 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-02a7bac5-fe86-4f82-8804-326c00d5cc04 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:56.153500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-02a7bac5-fe86-4f82-8804-326c00d5cc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:56.186641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd6d88-1cb9-4280-b0bd-c51f6323e43a None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:56.192566 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:56.226909 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae62a3-9565-4c8b-8004-bea9d0aae96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:56.227523 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae62a3-9565-4c8b-8004-bea9d0aae96a None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:56.227798 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae62a3-9565-4c8b-8004-bea9d0aae96a None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:56.228110 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae62a3-9565-4c8b-8004-bea9d0aae96a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:56.242235 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 177/342] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:10:56.243927 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d8ec6-5939-4bdf-98da-d48ac698cff9 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:56.244213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d8ec6-5939-4bdf-98da-d48ac698cff9 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:56.244485 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d8ec6-5939-4bdf-98da-d48ac698cff9 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:56.246844 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 178/343] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:56.247582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d8ec6-5939-4bdf-98da-d48ac698cff9 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:56.351283 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae62a3-9565-4c8b-8004-bea9d0aae96a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:56.353026 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae62a3-9565-4c8b-8004-bea9d0aae96a None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:56.370069 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d8ec6-5939-4bdf-98da-d48ac698cff9 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:56.411985 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:56.413809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f6dd0-d2b5-4d45-9150-57e71f5098b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:56.414479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f6dd0-d2b5-4d45-9150-57e71f5098b7 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:56.414760 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f6dd0-d2b5-4d45-9150-57e71f5098b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:56.415037 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f6dd0-d2b5-4d45-9150-57e71f5098b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:56.429284 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f6dd0-d2b5-4d45-9150-57e71f5098b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:56.435470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-761f6dd0-d2b5-4d45-9150-57e71f5098b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:10:56.435470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:56.435470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:56.435470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:56.435470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:56.435470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:56.435470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:56.435470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:56.435470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:56.435470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:56.435470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:56.435470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:56.435470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:56.435470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:56.435470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:56.435470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:56.437550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:56.437550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:56.437550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:56.437550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:56.437550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:56.437550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:56.437550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:56.437550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:56.437550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:56.437550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:56.437550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:56.437550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:56.437550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:56.437550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:56.437550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:56.437550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:56.439498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:56.439498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:56.439498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:56.439498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:56.439498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:56.439498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:56.439498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:56.439498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:56.439498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:56.439498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:56.439498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:10:56.439498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:56.439498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 179/344] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:10:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:56.439498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97ac80-00a7-4d35-a24c-77237fbc526a None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:56.441255 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97ac80-00a7-4d35-a24c-77237fbc526a None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:56.441255 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97ac80-00a7-4d35-a24c-77237fbc526a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:56.461228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-ab97ac80-00a7-4d35-a24c-77237fbc526a None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:56.462507 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-ab97ac80-00a7-4d35-a24c-77237fbc526a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:56.487995 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:56.546223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 180/345] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:56.553473 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97ac80-00a7-4d35-a24c-77237fbc526a None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:56.589696 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 166/346] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:56.595331 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae62a3-9565-4c8b-8004-bea9d0aae96a None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:56.669269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97ac80-00a7-4d35-a24c-77237fbc526a None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:56.711211 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038018-bfae-4b5b-bee2-bfafef96e625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:56.712229 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038018-bfae-4b5b-bee2-bfafef96e625 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:56.712657 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038018-bfae-4b5b-bee2-bfafef96e625 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:56.713101 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038018-bfae-4b5b-bee2-bfafef96e625 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:56.713913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40038018-bfae-4b5b-bee2-bfafef96e625 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:56.714747 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40038018-bfae-4b5b-bee2-bfafef96e625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:56.716278 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40038018-bfae-4b5b-bee2-bfafef96e625 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:56.726240 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 181/347] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:10:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:56.738424 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038018-bfae-4b5b-bee2-bfafef96e625 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:56.763106 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:56.844345 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae62a3-9565-4c8b-8004-bea9d0aae96a None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:56.865378 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038018-bfae-4b5b-bee2-bfafef96e625 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:56.881878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba3f84-39d4-43e1-a078-5b2ab183401d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:56.882842 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3f84-39d4-43e1-a078-5b2ab183401d None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:56.883314 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3f84-39d4-43e1-a078-5b2ab183401d None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:56.883795 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3f84-39d4-43e1-a078-5b2ab183401d None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:56.885160 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba3f84-39d4-43e1-a078-5b2ab183401d None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:56.887602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba3f84-39d4-43e1-a078-5b2ab183401d None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:56.890335 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 167/348] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:56 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:56.891777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cd73b-8860-4984-8880-bb7e3f7de2f8 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:56.892256 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cd73b-8860-4984-8880-bb7e3f7de2f8 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:56.892739 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cd73b-8860-4984-8880-bb7e3f7de2f8 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:56.894581 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:56.895025 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 168/349] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:56.900432 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cd73b-8860-4984-8880-bb7e3f7de2f8 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:56.915627 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80aa6fb-de5a-48ed-aff7-04980cc300db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:56.916720 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aa6fb-de5a-48ed-aff7-04980cc300db None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:56.917834 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aa6fb-de5a-48ed-aff7-04980cc300db None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:56.918584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aa6fb-de5a-48ed-aff7-04980cc300db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:57.015546 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80aa6fb-de5a-48ed-aff7-04980cc300db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:57.023497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80aa6fb-de5a-48ed-aff7-04980cc300db None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:57.024425 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cd73b-8860-4984-8880-bb7e3f7de2f8 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:57.049260 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:57.063852 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7666aea-1257-49c4-9873-bd7b0d73910e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:57.064821 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7666aea-1257-49c4-9873-bd7b0d73910e None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:57.065321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7666aea-1257-49c4-9873-bd7b0d73910e None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:57.065782 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7666aea-1257-49c4-9873-bd7b0d73910e None admin] PATH_INFO: `/v3/groups/f6a0c06b697c487798ca34365dd85e6f` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:57.077878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7666aea-1257-49c4-9873-bd7b0d73910e None admin] RBAC: Authorizing `identity:get_group(group_id=f6a0c06b697c487798ca34365dd85e6f)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:57.079654 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7666aea-1257-49c4-9873-bd7b0d73910e None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:57.081612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 169/350] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Aug 19 01:10:56 2022] GET /identity/v3/groups/f6a0c06b697c487798ca34365dd85e6f => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:57.082948 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f065687-07b1-4cd3-abbf-843951b820fc None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:57.083390 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f065687-07b1-4cd3-abbf-843951b820fc None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:57.084628 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f065687-07b1-4cd3-abbf-843951b820fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:57.106915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-3f065687-07b1-4cd3-abbf-843951b820fc None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:57.108495 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-3f065687-07b1-4cd3-abbf-843951b820fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:57.155369 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 182/351] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:57.156309 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80aa6fb-de5a-48ed-aff7-04980cc300db None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:57.181406 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:57.210901 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 170/352] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:57.211725 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f065687-07b1-4cd3-abbf-843951b820fc None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:57.293816 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80aa6fb-de5a-48ed-aff7-04980cc300db None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:57.324087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:57.344367 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a2c95-0017-487d-985b-aa6fea84a50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:57.345035 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a2c95-0017-487d-985b-aa6fea84a50a None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:57.345318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a2c95-0017-487d-985b-aa6fea84a50a None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:57.345594 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a2c95-0017-487d-985b-aa6fea84a50a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:57.349786 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f065687-07b1-4cd3-abbf-843951b820fc None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:57.357247 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a2c95-0017-487d-985b-aa6fea84a50a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:57.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-c30a2c95-0017-487d-985b-aa6fea84a50a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:57.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:57.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:57.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:57.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:57.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:57.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:57.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:57.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:57.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:57.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:57.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:57.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:57.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:57.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:57.367251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:57.368181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:57.368181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:57.368181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:57.368181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:57.368181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:57.368181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:57.368181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:57.368181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:57.368181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:57.368181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:57.368181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:57.368181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:57.368181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:57.368181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:57.368181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:57.368181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:57.369016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:57.369016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:57.369016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:57.369016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:57.369016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:57.369016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:57.369016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:57.369016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:57.369016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:57.369016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:57.369016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:10:57.369016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:57.369016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 183/353] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:57.371733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a2c95-0017-487d-985b-aa6fea84a50a None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:57.394906 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ae79-b486-4b1d-b32d-aed2e62697d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:57.395952 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ae79-b486-4b1d-b32d-aed2e62697d1 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:57.396681 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ae79-b486-4b1d-b32d-aed2e62697d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:57.397290 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ae79-b486-4b1d-b32d-aed2e62697d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:57.398341 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951ae79-b486-4b1d-b32d-aed2e62697d1 None admin] RBAC: Adding query filter params (group.id=f6a0c06b697c487798ca34365dd85e6f, role.id=f8c07e35d799437cbb53316acc2fc030, scope.project.id=926d0bea317c4b8a9c79dcb750be0c31) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:57.398844 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951ae79-b486-4b1d-b32d-aed2e62697d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:57.400484 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951ae79-b486-4b1d-b32d-aed2e62697d1 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:57.407544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 171/354] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Aug 19 01:10:57 2022] GET /identity/v3/role_assignments?group.id=f6a0c06b697c487798ca34365dd85e6f&scope.project.id=926d0bea317c4b8a9c79dcb750be0c31&role.id=f8c07e35d799437cbb53316acc2fc030 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:57.408692 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ae79-b486-4b1d-b32d-aed2e62697d1 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:57.485884 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:57.541469 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a2c95-0017-487d-985b-aa6fea84a50a None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:57.570175 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ae79-b486-4b1d-b32d-aed2e62697d1 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:57.601079 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a84525-657b-4a38-b7a8-f95620610876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:57.602193 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a84525-657b-4a38-b7a8-f95620610876 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:57.602570 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a84525-657b-4a38-b7a8-f95620610876 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:57.602939 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a84525-657b-4a38-b7a8-f95620610876 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:57.617114 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a84525-657b-4a38-b7a8-f95620610876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:57.618978 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202772cb-936e-4fff-9a2a-5649a6845f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:57.619818 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202772cb-936e-4fff-9a2a-5649a6845f4b None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:57.620316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202772cb-936e-4fff-9a2a-5649a6845f4b None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:57.621426 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202772cb-936e-4fff-9a2a-5649a6845f4b None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:57.622872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202772cb-936e-4fff-9a2a-5649a6845f4b None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:57.623587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-c1a84525-657b-4a38-b7a8-f95620610876 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:57.623587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:57.623587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:57.623587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:57.623587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:57.623587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:57.623587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:57.623587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:57.623587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:57.623587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:57.623587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:57.623587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:57.623587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:57.623587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:57.623587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:57.623587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:57.624414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:57.624414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:57.624414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:57.624414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:57.624414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:57.624414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:57.624414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:57.624414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:57.624414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:57.624414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:57.624414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:57.624414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:57.624414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:57.624414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:57.624414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:57.624414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:57.625263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:57.625263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:57.625263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:57.625263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:57.625263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:57.625263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:57.625263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:57.625263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:57.625263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:57.625263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:57.625263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 01:10:57.625263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:10:57.626888 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202772cb-936e-4fff-9a2a-5649a6845f4b None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:57.626987 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 184/355] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:57.626987 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a84525-657b-4a38-b7a8-f95620610876 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:57.627120 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 172/356] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:57 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:57.627708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9eb69-6466-4684-bd7c-1b8cef7c64ec None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:57.627997 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9eb69-6466-4684-bd7c-1b8cef7c64ec None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:57.628271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9eb69-6466-4684-bd7c-1b8cef7c64ec None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:57.629616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 173/357] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:10:57.632883 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9eb69-6466-4684-bd7c-1b8cef7c64ec None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:57.681011 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:57.759748 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a84525-657b-4a38-b7a8-f95620610876 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:57.771320 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9eb69-6466-4684-bd7c-1b8cef7c64ec None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:57.796714 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:57.803458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b97f2-a8a9-4a6c-bdee-3b5c77c327d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:57.809820 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b97f2-a8a9-4a6c-bdee-3b5c77c327d0 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:57.809820 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b97f2-a8a9-4a6c-bdee-3b5c77c327d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:57.809820 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b97f2-a8a9-4a6c-bdee-3b5c77c327d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:57.809820 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b97f2-a8a9-4a6c-bdee-3b5c77c327d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:57.809820 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b97f2-a8a9-4a6c-bdee-3b5c77c327d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:57.809820 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b97f2-a8a9-4a6c-bdee-3b5c77c327d0 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:57.820316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b3e21-ceed-43a7-a387-15db43d47229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:57.820965 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 185/358] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:57.821623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b3e21-ceed-43a7-a387-15db43d47229 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:57.821883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b97f2-a8a9-4a6c-bdee-3b5c77c327d0 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:57.822294 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b3e21-ceed-43a7-a387-15db43d47229 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:57.822816 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b3e21-ceed-43a7-a387-15db43d47229 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:57.837709 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b3e21-ceed-43a7-a387-15db43d47229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:57.843898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-993b3e21-ceed-43a7-a387-15db43d47229 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:10:57.843898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:57.843898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:57.843898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:57.843898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:57.843898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:57.843898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:57.843898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:57.843898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:57.843898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:57.843898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:57.843898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:57.843898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:57.843898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:57.843898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:57.843898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:57.844817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:57.844817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:57.844817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:57.844817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:57.844817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:57.844817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:57.844817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:57.844817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:57.844817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:57.844817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:57.844817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:57.844817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:57.844817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:57.844817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:57.844817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:57.844817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:57.845662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:57.845662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:57.845662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:57.845662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:57.845662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:57.845662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:57.845662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:57.845662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:57.845662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:57.845662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:57.845662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:10:57.845662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:57.847183 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 174/359] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:10:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:57.847394 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b3e21-ceed-43a7-a387-15db43d47229 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:57.952413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:57.955381 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b97f2-a8a9-4a6c-bdee-3b5c77c327d0 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:57.994885 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b3e21-ceed-43a7-a387-15db43d47229 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:58.004927 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1682b48-1c59-4dbe-aeab-b93d97fbff9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:58.004927 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1682b48-1c59-4dbe-aeab-b93d97fbff9d None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:58.004927 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1682b48-1c59-4dbe-aeab-b93d97fbff9d None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:58.004927 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1682b48-1c59-4dbe-aeab-b93d97fbff9d None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:58.005463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1682b48-1c59-4dbe-aeab-b93d97fbff9d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:58.006137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1682b48-1c59-4dbe-aeab-b93d97fbff9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:58.007962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1682b48-1c59-4dbe-aeab-b93d97fbff9d None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:58.022060 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 186/360] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:10:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:58.028398 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42ea33-f57d-476a-82d3-5ce68d65d971 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:58.028718 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42ea33-f57d-476a-82d3-5ce68d65d971 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:58.029052 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42ea33-f57d-476a-82d3-5ce68d65d971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:58.036223 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60458f1b-1e68-43da-b3a9-d4630dcb49d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:58.036909 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60458f1b-1e68-43da-b3a9-d4630dcb49d6 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:58.037163 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60458f1b-1e68-43da-b3a9-d4630dcb49d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:58.037434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60458f1b-1e68-43da-b3a9-d4630dcb49d6 None admin] PATH_INFO: `/v3/groups/f6a0c06b697c487798ca34365dd85e6f` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:58.039124 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60458f1b-1e68-43da-b3a9-d4630dcb49d6 None admin] RBAC: Authorizing `identity:get_group(group_id=f6a0c06b697c487798ca34365dd85e6f)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:58.040574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60458f1b-1e68-43da-b3a9-d4630dcb49d6 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:58.042339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 175/361] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Aug 19 01:10:57 2022] GET /identity/v3/groups/f6a0c06b697c487798ca34365dd85e6f => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:58.043044 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60458f1b-1e68-43da-b3a9-d4630dcb49d6 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:58.052368 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-bb42ea33-f57d-476a-82d3-5ce68d65d971 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:10:58.053634 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-bb42ea33-f57d-476a-82d3-5ce68d65d971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:10:58.115741 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:58.137259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 187/362] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:10:58.138900 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42ea33-f57d-476a-82d3-5ce68d65d971 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:58.179417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60458f1b-1e68-43da-b3a9-d4630dcb49d6 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:58.219773 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b69ca-0f36-441d-807e-b6e4c3f55501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:58.220324 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b69ca-0f36-441d-807e-b6e4c3f55501 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:58.220604 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b69ca-0f36-441d-807e-b6e4c3f55501 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:58.220907 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b69ca-0f36-441d-807e-b6e4c3f55501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:58.275593 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:58.288179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42ea33-f57d-476a-82d3-5ce68d65d971 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:58.301899 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b69ca-0f36-441d-807e-b6e4c3f55501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:58.303525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b69ca-0f36-441d-807e-b6e4c3f55501 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:58.332742 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80390b9b-89b1-4a39-a44b-a69174192dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:58.333396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80390b9b-89b1-4a39-a44b-a69174192dcb None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:58.333929 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80390b9b-89b1-4a39-a44b-a69174192dcb None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:58.334207 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80390b9b-89b1-4a39-a44b-a69174192dcb None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:58.335293 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80390b9b-89b1-4a39-a44b-a69174192dcb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:58.335598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80390b9b-89b1-4a39-a44b-a69174192dcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:58.338160 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80390b9b-89b1-4a39-a44b-a69174192dcb None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:58.348456 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 188/363] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:10:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:58.353416 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80390b9b-89b1-4a39-a44b-a69174192dcb None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:58.374083 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:58.445301 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 176/364] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:58.446171 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b69ca-0f36-441d-807e-b6e4c3f55501 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:58.493974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80390b9b-89b1-4a39-a44b-a69174192dcb None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:58.540883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8feca25-6702-4866-92d4-fde05133949f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:58.541591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8feca25-6702-4866-92d4-fde05133949f None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:58.541930 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8feca25-6702-4866-92d4-fde05133949f None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:58.542604 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8feca25-6702-4866-92d4-fde05133949f None admin] PATH_INFO: `/v3/users/b5c33ad9c2e447d5a8a00bfaa5bdd98b` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:58.544494 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8feca25-6702-4866-92d4-fde05133949f None admin] RBAC: Authorizing `identity:get_user(user_id=b5c33ad9c2e447d5a8a00bfaa5bdd98b)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:58.546349 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8feca25-6702-4866-92d4-fde05133949f None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:58.548280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 189/365] 10.222.0.82 () {56 vars in 1177 bytes} [Fri Aug 19 01:10:58 2022] GET /identity/v3/users/b5c33ad9c2e447d5a8a00bfaa5bdd98b => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:58.553185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8feca25-6702-4866-92d4-fde05133949f None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:58.584264 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:58.587451 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b69ca-0f36-441d-807e-b6e4c3f55501 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:58.631456 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de4428-b1dd-491a-9050-6f5ff04e77ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:58.632163 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de4428-b1dd-491a-9050-6f5ff04e77ba None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:58.632443 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de4428-b1dd-491a-9050-6f5ff04e77ba None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:58.632708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de4428-b1dd-491a-9050-6f5ff04e77ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:58.633513 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de4428-b1dd-491a-9050-6f5ff04e77ba None admin] RBAC: Adding query filter params (group.id=f6a0c06b697c487798ca34365dd85e6f, role.id=63d0d2b4616248b3aa738ec590e2e4b3, scope.project.id=926d0bea317c4b8a9c79dcb750be0c31) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:58.633814 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de4428-b1dd-491a-9050-6f5ff04e77ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:58.635325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de4428-b1dd-491a-9050-6f5ff04e77ba None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:58.643418 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 177/366] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Aug 19 01:10:58 2022] GET /identity/v3/role_assignments?group.id=f6a0c06b697c487798ca34365dd85e6f&scope.project.id=926d0bea317c4b8a9c79dcb750be0c31&role.id=63d0d2b4616248b3aa738ec590e2e4b3 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:58.645631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de4428-b1dd-491a-9050-6f5ff04e77ba None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:58.667918 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:58.711845 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8feca25-6702-4866-92d4-fde05133949f None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:58.767890 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac4852-c777-48ad-99cc-53fff8acc8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:58.768522 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac4852-c777-48ad-99cc-53fff8acc8d7 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:58.768802 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac4852-c777-48ad-99cc-53fff8acc8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:58.769102 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac4852-c777-48ad-99cc-53fff8acc8d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:58.783899 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de4428-b1dd-491a-9050-6f5ff04e77ba None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:58.829733 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f8e9b-24dc-45ee-bdcf-f8b58027cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:58.830398 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f8e9b-24dc-45ee-bdcf-f8b58027cd92 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:58.830681 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f8e9b-24dc-45ee-bdcf-f8b58027cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:58.830951 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f8e9b-24dc-45ee-bdcf-f8b58027cd92 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:58.832821 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f8e9b-24dc-45ee-bdcf-f8b58027cd92 None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:58.834637 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f8e9b-24dc-45ee-bdcf-f8b58027cd92 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:58.837524 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 178/367] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:58 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:58.838849 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f8e9b-24dc-45ee-bdcf-f8b58027cd92 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:58.874292 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac4852-c777-48ad-99cc-53fff8acc8d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:58.875909 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac4852-c777-48ad-99cc-53fff8acc8d7 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:58.902150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:58.952772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:58.977461 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f8e9b-24dc-45ee-bdcf-f8b58027cd92 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:58.998329 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 190/368] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:10:58.999216 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac4852-c777-48ad-99cc-53fff8acc8d7 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:59.028293 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81526272-3946-49a5-a234-737007867bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:59.029335 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81526272-3946-49a5-a234-737007867bc3 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:59.029829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81526272-3946-49a5-a234-737007867bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:59.030301 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81526272-3946-49a5-a234-737007867bc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:59.044174 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81526272-3946-49a5-a234-737007867bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:10:59.050518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-81526272-3946-49a5-a234-737007867bc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:59.050518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:10:59.050518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:10:59.050518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:10:59.050518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:10:59.050518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:10:59.050518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:10:59.050518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:10:59.050518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:10:59.050518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:10:59.050518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:10:59.050518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:10:59.050518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:10:59.050518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:10:59.050518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:10:59.050518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:10:59.051446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:10:59.051446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:10:59.051446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:10:59.051446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:10:59.051446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:10:59.051446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:10:59.051446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:10:59.051446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:10:59.051446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:10:59.051446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:10:59.051446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:10:59.051446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:10:59.051446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:10:59.051446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:10:59.051446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:10:59.051446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:10:59.052270 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:10:59.052270 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:10:59.052270 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:10:59.052270 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:10:59.052270 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:10:59.052270 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:10:59.052270 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:10:59.052270 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:10:59.052270 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:10:59.052270 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:10:59.052270 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:10:59.052270 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:10:59.055311 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 179/369] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:10:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:10:59.056667 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81526272-3946-49a5-a234-737007867bc3 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:59.133794 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac4852-c777-48ad-99cc-53fff8acc8d7 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:59.166572 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:59.182743 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde847d-5674-4af5-8dfa-126e0f7cb888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:59.188801 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81526272-3946-49a5-a234-737007867bc3 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:59.189275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde847d-5674-4af5-8dfa-126e0f7cb888 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:59.189275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde847d-5674-4af5-8dfa-126e0f7cb888 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:59.189275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde847d-5674-4af5-8dfa-126e0f7cb888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:59.189275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde847d-5674-4af5-8dfa-126e0f7cb888 None admin] RBAC: Adding query filter params (role.id=a39067aef3054bfb828616339857085f, user.id=b5c33ad9c2e447d5a8a00bfaa5bdd98b, scope.system=all) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:59.189275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde847d-5674-4af5-8dfa-126e0f7cb888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:59.189275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde847d-5674-4af5-8dfa-126e0f7cb888 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:59.205986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 191/370] 10.222.0.82 () {56 vars in 1308 bytes} [Fri Aug 19 01:10:58 2022] GET /identity/v3/role_assignments?user.id=b5c33ad9c2e447d5a8a00bfaa5bdd98b&scope.system=all&role.id=a39067aef3054bfb828616339857085f => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:59.207480 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde847d-5674-4af5-8dfa-126e0f7cb888 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:59.227710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84901a-f5fb-4bd0-9671-78992d20f126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:59.228392 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84901a-f5fb-4bd0-9671-78992d20f126 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:59.228677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84901a-f5fb-4bd0-9671-78992d20f126 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:59.228995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84901a-f5fb-4bd0-9671-78992d20f126 None admin] PATH_INFO: `/v3/groups/f6a0c06b697c487798ca34365dd85e6f` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:59.230870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84901a-f5fb-4bd0-9671-78992d20f126 None admin] RBAC: Authorizing `identity:get_group(group_id=f6a0c06b697c487798ca34365dd85e6f)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:59.233283 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84901a-f5fb-4bd0-9671-78992d20f126 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:59.235448 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 180/371] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Aug 19 01:10:59 2022] GET /identity/v3/groups/f6a0c06b697c487798ca34365dd85e6f => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:59.236369 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84901a-f5fb-4bd0-9671-78992d20f126 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:59.253632 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:59.435120 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84901a-f5fb-4bd0-9671-78992d20f126 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:59.451102 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde847d-5674-4af5-8dfa-126e0f7cb888 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:59.483831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea22e3-1c8e-4210-9100-da685c94771c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:59.484460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea22e3-1c8e-4210-9100-da685c94771c None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:59.484740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea22e3-1c8e-4210-9100-da685c94771c None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:59.485063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea22e3-1c8e-4210-9100-da685c94771c None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:59.486018 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea22e3-1c8e-4210-9100-da685c94771c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:59.486325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea22e3-1c8e-4210-9100-da685c94771c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:59.488402 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea22e3-1c8e-4210-9100-da685c94771c None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:59.499316 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746d873-9de6-4cda-8498-9e37c565fe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:59.499977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746d873-9de6-4cda-8498-9e37c565fe58 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:59.500257 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746d873-9de6-4cda-8498-9e37c565fe58 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:59.500585 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746d873-9de6-4cda-8498-9e37c565fe58 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:59.501800 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746d873-9de6-4cda-8498-9e37c565fe58 None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:59.502555 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 181/372] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:10:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:59.503409 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea22e3-1c8e-4210-9100-da685c94771c None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:59.503593 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746d873-9de6-4cda-8498-9e37c565fe58 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:59.509768 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 192/373] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:59 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:59.512017 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746d873-9de6-4cda-8498-9e37c565fe58 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:59.581145 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:59.622107 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:59.662255 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746d873-9de6-4cda-8498-9e37c565fe58 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:59.679332 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea22e3-1c8e-4210-9100-da685c94771c None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:59.715154 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7f81f-7638-4c42-87a5-96dbc6496637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:59.715755 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7f81f-7638-4c42-87a5-96dbc6496637 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:59.716035 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7f81f-7638-4c42-87a5-96dbc6496637 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:59.716613 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7f81f-7638-4c42-87a5-96dbc6496637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:59.731513 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7a131-1b09-4a37-a435-96c2ff17b422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:59.732134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7a131-1b09-4a37-a435-96c2ff17b422 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:59.732413 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7a131-1b09-4a37-a435-96c2ff17b422 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:59.732688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7a131-1b09-4a37-a435-96c2ff17b422 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:59.735457 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7a131-1b09-4a37-a435-96c2ff17b422 None admin] RBAC: Adding query filter params (group.id=f6a0c06b697c487798ca34365dd85e6f, role.id=f8c07e35d799437cbb53316acc2fc030, scope.project.id=d5da12a5841547c28a9b31bce0ec15db) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:10:59.735776 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7a131-1b09-4a37-a435-96c2ff17b422 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:59.737451 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7a131-1b09-4a37-a435-96c2ff17b422 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:59.743736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 182/374] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Aug 19 01:10:59 2022] GET /identity/v3/role_assignments?group.id=f6a0c06b697c487798ca34365dd85e6f&scope.project.id=d5da12a5841547c28a9b31bce0ec15db&role.id=f8c07e35d799437cbb53316acc2fc030 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:59.744630 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7a131-1b09-4a37-a435-96c2ff17b422 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:59.811232 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7f81f-7638-4c42-87a5-96dbc6496637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:59.813273 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7f81f-7638-4c42-87a5-96dbc6496637 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:59.882462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:10:59.899014 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7a131-1b09-4a37-a435-96c2ff17b422 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:10:59.956999 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75161a43-286c-4137-a53d-5a451790b3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:10:59.958065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161a43-286c-4137-a53d-5a451790b3ef None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:10:59.958585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161a43-286c-4137-a53d-5a451790b3ef None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:10:59.959058 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161a43-286c-4137-a53d-5a451790b3ef None admin] PATH_INFO: `/v3/groups/f6a0c06b697c487798ca34365dd85e6f` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:10:59.959980 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 193/375] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 01:10:59.964916 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75161a43-286c-4137-a53d-5a451790b3ef None admin] RBAC: Authorizing `identity:get_group(group_id=f6a0c06b697c487798ca34365dd85e6f)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:10:59.966484 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7f81f-7638-4c42-87a5-96dbc6496637 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:59.966997 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75161a43-286c-4137-a53d-5a451790b3ef None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:10:59.969717 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 183/376] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Aug 19 01:10:59 2022] GET /identity/v3/groups/f6a0c06b697c487798ca34365dd85e6f => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:10:59.978114 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75161a43-286c-4137-a53d-5a451790b3ef None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:10:59.983724 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:00.098700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7f81f-7638-4c42-87a5-96dbc6496637 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:00.144925 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c17ed0-31b1-4aa1-8040-3aaf660d6d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:00.145570 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c17ed0-31b1-4aa1-8040-3aaf660d6d16 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:00.145849 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c17ed0-31b1-4aa1-8040-3aaf660d6d16 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:00.146389 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c17ed0-31b1-4aa1-8040-3aaf660d6d16 None admin] PATH_INFO: `/v3/projects/cd377ed4c2f045fc8b576211274579df` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:00.148121 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c17ed0-31b1-4aa1-8040-3aaf660d6d16 None admin] RBAC: Authorizing `identity:get_project(project_id=cd377ed4c2f045fc8b576211274579df)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:00.149932 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c17ed0-31b1-4aa1-8040-3aaf660d6d16 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:00.153712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 194/377] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:10:59 2022] GET /identity/v3/projects/cd377ed4c2f045fc8b576211274579df => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:00.155393 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed448dd5-01c4-4f77-b096-bd22e79d0a92 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:00.155685 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed448dd5-01c4-4f77-b096-bd22e79d0a92 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:00.155959 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed448dd5-01c4-4f77-b096-bd22e79d0a92 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:00.157681 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 195/378] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:00.158616 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed448dd5-01c4-4f77-b096-bd22e79d0a92 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:00.158910 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75161a43-286c-4137-a53d-5a451790b3ef None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:00.181231 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:00.206129 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c708be-1cb5-45ab-971f-cabf28ddbd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:00.207306 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c708be-1cb5-45ab-971f-cabf28ddbd42 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:00.216254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c708be-1cb5-45ab-971f-cabf28ddbd42 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:00.216254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c708be-1cb5-45ab-971f-cabf28ddbd42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:00.216254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c708be-1cb5-45ab-971f-cabf28ddbd42 None admin] RBAC: Adding query filter params (group.id=f6a0c06b697c487798ca34365dd85e6f, role.id=63d0d2b4616248b3aa738ec590e2e4b3, scope.project.id=d5da12a5841547c28a9b31bce0ec15db) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:00.216254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c708be-1cb5-45ab-971f-cabf28ddbd42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:00.216254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c708be-1cb5-45ab-971f-cabf28ddbd42 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:00.219902 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 184/379] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Aug 19 01:10:59 2022] GET /identity/v3/role_assignments?group.id=f6a0c06b697c487798ca34365dd85e6f&scope.project.id=d5da12a5841547c28a9b31bce0ec15db&role.id=63d0d2b4616248b3aa738ec590e2e4b3 => generated 260 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:00.221359 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4d3b0-b64f-4d0b-9716-1903c78195ea None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:00.226524 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4d3b0-b64f-4d0b-9716-1903c78195ea None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:00.227301 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4d3b0-b64f-4d0b-9716-1903c78195ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:00.257743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-acf4d3b0-b64f-4d0b-9716-1903c78195ea None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:00.259283 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-acf4d3b0-b64f-4d0b-9716-1903c78195ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:00.286707 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed448dd5-01c4-4f77-b096-bd22e79d0a92 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:00.330258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4274401-8083-40fc-9241-bde1b7607434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:00.330902 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4274401-8083-40fc-9241-bde1b7607434 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:00.331178 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4274401-8083-40fc-9241-bde1b7607434 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:00.331448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4274401-8083-40fc-9241-bde1b7607434 None admin] PATH_INFO: `/v3/groups/435eb7c713024662b3d16f21f3d4bd98` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:00.348638 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4274401-8083-40fc-9241-bde1b7607434 None admin] RBAC: Authorizing `identity:get_group(group_id=435eb7c713024662b3d16f21f3d4bd98)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:00.350158 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4274401-8083-40fc-9241-bde1b7607434 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:00.351881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 196/380] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Aug 19 01:11:00 2022] GET /identity/v3/groups/435eb7c713024662b3d16f21f3d4bd98 => generated 229 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:00.358761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4274401-8083-40fc-9241-bde1b7607434 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:00.400359 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:00.414743 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 185/381] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:00.484885 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:00.505731 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4274401-8083-40fc-9241-bde1b7607434 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:00.556684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f23df8-2c28-4854-8b5d-eb7c86ffd6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:00.557265 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f23df8-2c28-4854-8b5d-eb7c86ffd6f5 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:00.557549 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f23df8-2c28-4854-8b5d-eb7c86ffd6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:00.558404 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f23df8-2c28-4854-8b5d-eb7c86ffd6f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:00.559397 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f23df8-2c28-4854-8b5d-eb7c86ffd6f5 None admin] RBAC: Adding query filter params (group.id=435eb7c713024662b3d16f21f3d4bd98, role.id=fda5389edef24d6baac46d87242d285b, scope.project.id=cd377ed4c2f045fc8b576211274579df) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:00.559712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f23df8-2c28-4854-8b5d-eb7c86ffd6f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:00.561260 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f23df8-2c28-4854-8b5d-eb7c86ffd6f5 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:00.567717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 197/382] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Aug 19 01:11:00 2022] GET /identity/v3/role_assignments?group.id=435eb7c713024662b3d16f21f3d4bd98&scope.project.id=cd377ed4c2f045fc8b576211274579df&role.id=fda5389edef24d6baac46d87242d285b => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:00.997050 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4d3b0-b64f-4d0b-9716-1903c78195ea None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:01.114928 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4d3b0-b64f-4d0b-9716-1903c78195ea None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:01.160516 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa70964-e7ca-40cb-9f91-47927b81802a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:01.161375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa70964-e7ca-40cb-9f91-47927b81802a None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:01.161567 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa70964-e7ca-40cb-9f91-47927b81802a None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:01.161892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa70964-e7ca-40cb-9f91-47927b81802a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:01.178046 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa70964-e7ca-40cb-9f91-47927b81802a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:01.183009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-1fa70964-e7ca-40cb-9f91-47927b81802a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:11:01.183009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:01.183009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:01.183009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:01.183009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:01.183009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:01.183009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:01.183009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:01.183009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:01.183009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:01.183009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:01.183009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:01.183009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:01.183009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:01.183009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:01.183009 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:01.183947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:01.183947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:01.183947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:01.183947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:01.183947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:01.183947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:01.183947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:01.183947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:01.183947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:01.183947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:01.183947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:01.183947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:01.183947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:01.183947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:01.183947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:01.183947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:01.184745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:01.184745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:01.184745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:01.184745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:01.184745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:01.184745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:01.184745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:01.184745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:01.184745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:01.184745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:01.184745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:11:01.184745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:01.189315 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 186/383] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:11:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:01.197141 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f23df8-2c28-4854-8b5d-eb7c86ffd6f5 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:01.394783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f23df8-2c28-4854-8b5d-eb7c86ffd6f5 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:01.444632 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060385f-087e-4a86-b4c3-10b48c391a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:01.445692 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060385f-087e-4a86-b4c3-10b48c391a0d None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:01.446184 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060385f-087e-4a86-b4c3-10b48c391a0d None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:01.446681 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060385f-087e-4a86-b4c3-10b48c391a0d None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:01.447580 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060385f-087e-4a86-b4c3-10b48c391a0d None admin] RBAC: Adding query filter params (name=member) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:01.448106 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060385f-087e-4a86-b4c3-10b48c391a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:01.450484 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060385f-087e-4a86-b4c3-10b48c391a0d None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:01.460841 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 198/384] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:11:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:01.467162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa70964-e7ca-40cb-9f91-47927b81802a None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:01.565959 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:01.615163 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa70964-e7ca-40cb-9f91-47927b81802a None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:01.654054 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bc303-0b1c-4c82-aaa5-59c1d3c1d206 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:01.654536 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bc303-0b1c-4c82-aaa5-59c1d3c1d206 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:01.654536 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bc303-0b1c-4c82-aaa5-59c1d3c1d206 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:01.655956 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 199/385] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:01.661862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f659c-c091-4dc1-80cb-1c9fe2955645 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:01.662149 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f659c-c091-4dc1-80cb-1c9fe2955645 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:01.663157 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f659c-c091-4dc1-80cb-1c9fe2955645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:01.676927 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8addd5-b572-400f-905b-ed70a62f32fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:01.678865 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8addd5-b572-400f-905b-ed70a62f32fa None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:01.679350 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8addd5-b572-400f-905b-ed70a62f32fa None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:01.679849 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8addd5-b572-400f-905b-ed70a62f32fa None admin] PATH_INFO: `/v3/groups/f6a0c06b697c487798ca34365dd85e6f` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:01.681391 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8addd5-b572-400f-905b-ed70a62f32fa None admin] RBAC: Authorizing `identity:get_group(group_id=f6a0c06b697c487798ca34365dd85e6f)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:01.683685 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8addd5-b572-400f-905b-ed70a62f32fa None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:01.685707 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 187/386] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Aug 19 01:11:01 2022] GET /identity/v3/groups/f6a0c06b697c487798ca34365dd85e6f => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:01.687526 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:01.693923 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8addd5-b572-400f-905b-ed70a62f32fa None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:01.701567 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-850f659c-c091-4dc1-80cb-1c9fe2955645 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:01.703711 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-850f659c-c091-4dc1-80cb-1c9fe2955645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:01.834049 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 200/387] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:01.869193 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8addd5-b572-400f-905b-ed70a62f32fa None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:01.894617 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:01.906458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855581e-1f2a-4233-b44d-8b8649cbc2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:01.907314 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855581e-1f2a-4233-b44d-8b8649cbc2b1 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:01.907777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855581e-1f2a-4233-b44d-8b8649cbc2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:01.908240 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855581e-1f2a-4233-b44d-8b8649cbc2b1 None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:01.911712 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855581e-1f2a-4233-b44d-8b8649cbc2b1 None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:01.913514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855581e-1f2a-4233-b44d-8b8649cbc2b1 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:01.915574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 188/388] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:11:01 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:01.924971 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f659c-c091-4dc1-80cb-1c9fe2955645 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:02.056212 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f659c-c091-4dc1-80cb-1c9fe2955645 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:02.097632 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb242ea-db37-4d12-b3c8-ef588433b25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:02.098310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb242ea-db37-4d12-b3c8-ef588433b25e None admin] REQUEST_METHOD: `PUT` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:02.098590 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb242ea-db37-4d12-b3c8-ef588433b25e None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:02.098865 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb242ea-db37-4d12-b3c8-ef588433b25e None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31/groups/f6a0c06b697c487798ca34365dd85e6f/roles/f8c07e35d799437cbb53316acc2fc030` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:02.100815 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb242ea-db37-4d12-b3c8-ef588433b25e None admin] RBAC: Authorizing `identity:create_grant(project_id=926d0bea317c4b8a9c79dcb750be0c31, group_id=f6a0c06b697c487798ca34365dd85e6f, role_id=f8c07e35d799437cbb53316acc2fc030)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:02.102288 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb242ea-db37-4d12-b3c8-ef588433b25e None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:02.106527 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:02.209364 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 201/389] 10.222.0.82 () {58 vars in 1442 bytes} [Fri Aug 19 01:11:01 2022] PUT /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31/groups/f6a0c06b697c487798ca34365dd85e6f/roles/f8c07e35d799437cbb53316acc2fc030 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 01:11:02.225003 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855581e-1f2a-4233-b44d-8b8649cbc2b1 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:02.361696 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855581e-1f2a-4233-b44d-8b8649cbc2b1 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:02.406507 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b671f2-18ad-4ccb-90bf-0066d0ab830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:02.407155 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b671f2-18ad-4ccb-90bf-0066d0ab830c None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:02.407437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b671f2-18ad-4ccb-90bf-0066d0ab830c None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:02.407778 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b671f2-18ad-4ccb-90bf-0066d0ab830c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:02.421685 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b671f2-18ad-4ccb-90bf-0066d0ab830c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:02.426673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-e8b671f2-18ad-4ccb-90bf-0066d0ab830c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:11:02.426673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:02.426673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:02.426673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:02.426673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:02.426673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:02.426673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:02.426673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:02.426673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:02.426673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:02.426673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:02.426673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:02.426673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:02.426673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:02.426673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:02.426673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:02.427525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:02.427525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:02.427525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:02.427525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:02.427525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:02.427525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:02.427525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:02.427525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:02.427525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:02.427525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:02.427525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:02.427525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:02.427525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:02.427525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:02.427525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:02.427525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:02.428314 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:02.428314 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:02.428314 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:02.428314 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:02.428314 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:02.428314 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:02.428314 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:02.428314 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:02.428314 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:02.428314 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:02.428314 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:11:02.428314 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:02.428940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 189/390] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:11:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:02.438027 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb242ea-db37-4d12-b3c8-ef588433b25e None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:02.576452 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb242ea-db37-4d12-b3c8-ef588433b25e None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:02.614253 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d36962-a4b6-4491-a2c2-6a64adb34210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:02.614863 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36962-a4b6-4491-a2c2-6a64adb34210 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:02.615145 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36962-a4b6-4491-a2c2-6a64adb34210 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:02.615416 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36962-a4b6-4491-a2c2-6a64adb34210 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:02.616080 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d36962-a4b6-4491-a2c2-6a64adb34210 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:02.616380 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d36962-a4b6-4491-a2c2-6a64adb34210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:02.617788 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d36962-a4b6-4491-a2c2-6a64adb34210 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:02.626453 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 202/391] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:02.631745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b671f2-18ad-4ccb-90bf-0066d0ab830c None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:02.704397 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:02.754354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b671f2-18ad-4ccb-90bf-0066d0ab830c None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:02.754543 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bc85a-ca7d-486b-a9c5-9bad1360547e None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:02.754965 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bc85a-ca7d-486b-a9c5-9bad1360547e None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:02.755039 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bc85a-ca7d-486b-a9c5-9bad1360547e None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:02.758854 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 203/392] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:02.766221 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572bb93-bed9-405a-b393-4390c63648f5 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:02.766475 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572bb93-bed9-405a-b393-4390c63648f5 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:02.766749 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572bb93-bed9-405a-b393-4390c63648f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:02.799682 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-4572bb93-bed9-405a-b393-4390c63648f5 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:02.800922 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-4572bb93-bed9-405a-b393-4390c63648f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:02.823311 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea960680-2a5f-42fb-9493-e45071f04406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:02.824514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea960680-2a5f-42fb-9493-e45071f04406 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:02.824930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea960680-2a5f-42fb-9493-e45071f04406 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:02.825444 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea960680-2a5f-42fb-9493-e45071f04406 None admin] PATH_INFO: `/v3/groups/f6a0c06b697c487798ca34365dd85e6f` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:02.826985 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea960680-2a5f-42fb-9493-e45071f04406 None admin] RBAC: Authorizing `identity:get_group(group_id=f6a0c06b697c487798ca34365dd85e6f)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:02.828573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea960680-2a5f-42fb-9493-e45071f04406 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:02.830189 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 190/393] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Aug 19 01:11:02 2022] GET /identity/v3/groups/f6a0c06b697c487798ca34365dd85e6f => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:02.835829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea960680-2a5f-42fb-9493-e45071f04406 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:02.916077 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:02.943673 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 204/394] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:02.991924 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea960680-2a5f-42fb-9493-e45071f04406 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:03.017110 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:03.038251 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccc288-28e7-4ff9-a47d-8ae9735440a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:03.038898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccc288-28e7-4ff9-a47d-8ae9735440a6 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:03.039175 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccc288-28e7-4ff9-a47d-8ae9735440a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:03.039444 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccc288-28e7-4ff9-a47d-8ae9735440a6 None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:03.041833 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccc288-28e7-4ff9-a47d-8ae9735440a6 None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:03.043826 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccc288-28e7-4ff9-a47d-8ae9735440a6 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:03.049951 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 191/395] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:11:02 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:03.056414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572bb93-bed9-405a-b393-4390c63648f5 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:03.209586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572bb93-bed9-405a-b393-4390c63648f5 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:03.252349 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa7b91-34c4-4498-bd0e-a4f515d4d30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:03.253074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7b91-34c4-4498-bd0e-a4f515d4d30d None admin] REQUEST_METHOD: `PUT` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:03.253362 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7b91-34c4-4498-bd0e-a4f515d4d30d None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:03.253641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7b91-34c4-4498-bd0e-a4f515d4d30d None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31/groups/f6a0c06b697c487798ca34365dd85e6f/roles/63d0d2b4616248b3aa738ec590e2e4b3` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:03.255981 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa7b91-34c4-4498-bd0e-a4f515d4d30d None admin] RBAC: Authorizing `identity:create_grant(project_id=926d0bea317c4b8a9c79dcb750be0c31, group_id=f6a0c06b697c487798ca34365dd85e6f, role_id=63d0d2b4616248b3aa738ec590e2e4b3)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:03.257536 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa7b91-34c4-4498-bd0e-a4f515d4d30d None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:03.381103 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 205/396] 10.222.0.82 () {58 vars in 1442 bytes} [Fri Aug 19 01:11:03 2022] PUT /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31/groups/f6a0c06b697c487798ca34365dd85e6f/roles/63d0d2b4616248b3aa738ec590e2e4b3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:11:03.420020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35306dba-2ea8-408e-9290-52ed71d23a3f None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:03.420020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35306dba-2ea8-408e-9290-52ed71d23a3f None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:03.420020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35306dba-2ea8-408e-9290-52ed71d23a3f None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:03.420723 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 192/397] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:03.426315 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0fbc0-4f28-4a7a-8b82-f4346d79cf9d None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:03.426809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0fbc0-4f28-4a7a-8b82-f4346d79cf9d None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:03.427228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0fbc0-4f28-4a7a-8b82-f4346d79cf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:03.447950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-43a0fbc0-4f28-4a7a-8b82-f4346d79cf9d None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:03.450218 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-43a0fbc0-4f28-4a7a-8b82-f4346d79cf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:03.525371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:03.559363 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 206/398] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:03.575261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35306dba-2ea8-408e-9290-52ed71d23a3f None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:03.698046 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35306dba-2ea8-408e-9290-52ed71d23a3f None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:03.740288 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463b82f-3b94-4d8b-b10c-40a527c802b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:03.740938 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463b82f-3b94-4d8b-b10c-40a527c802b9 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:03.741218 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463b82f-3b94-4d8b-b10c-40a527c802b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:03.741492 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463b82f-3b94-4d8b-b10c-40a527c802b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:03.750023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ac1ac-f81a-4bac-967e-512a48a4a5ba None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:03.750845 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ac1ac-f81a-4bac-967e-512a48a4a5ba None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:03.751589 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ac1ac-f81a-4bac-967e-512a48a4a5ba None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:03.758325 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 207/399] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:03.763370 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463b82f-3b94-4d8b-b10c-40a527c802b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:03.767623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-a463b82f-3b94-4d8b-b10c-40a527c802b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:11:03.767623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:03.767623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:03.767623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:03.767623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:03.767623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:03.767623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:03.767623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:03.767623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:03.767623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:03.767623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:03.767623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:03.767623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:03.767623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:03.767623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:03.767623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:03.769190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:03.769190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:03.769190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:03.769190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:03.769190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:03.769190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:03.769190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:03.769190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:03.769190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:03.769190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:03.769190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:03.769190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:03.769190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:03.769190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:03.769190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:03.769190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:03.772500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:03.772500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:03.772500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:03.772500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:03.772500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:03.772500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:03.772500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:03.772500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:03.772500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:03.772500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:03.772500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:11:03.772500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:03.772500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 193/400] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:11:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:03.776061 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463b82f-3b94-4d8b-b10c-40a527c802b9 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:03.779045 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44462b-5720-4aea-84d4-10a2a79235d1 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:03.779845 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44462b-5720-4aea-84d4-10a2a79235d1 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:03.780583 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44462b-5720-4aea-84d4-10a2a79235d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:03.822559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-0c44462b-5720-4aea-84d4-10a2a79235d1 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:03.826206 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-0c44462b-5720-4aea-84d4-10a2a79235d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:03.864904 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:03.914179 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463b82f-3b94-4d8b-b10c-40a527c802b9 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:03.956996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 208/401] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:03.963013 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4080ef-d4d8-4433-ac74-8f72d758e209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:03.963643 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4080ef-d4d8-4433-ac74-8f72d758e209 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:03.964096 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4080ef-d4d8-4433-ac74-8f72d758e209 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:03.964502 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4080ef-d4d8-4433-ac74-8f72d758e209 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:03.965464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4080ef-d4d8-4433-ac74-8f72d758e209 None admin] RBAC: Adding query filter params (name=member) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:03.965769 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4080ef-d4d8-4433-ac74-8f72d758e209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:03.967152 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4080ef-d4d8-4433-ac74-8f72d758e209 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:03.984253 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 194/402] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:11:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:03.989733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44462b-5720-4aea-84d4-10a2a79235d1 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:04.101792 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44462b-5720-4aea-84d4-10a2a79235d1 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:04.112710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4080ef-d4d8-4433-ac74-8f72d758e209 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:04.113638 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:04.164202 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a06047-5772-436c-bdb9-cd7f4ab94a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:04.164840 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a06047-5772-436c-bdb9-cd7f4ab94a55 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:04.165141 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a06047-5772-436c-bdb9-cd7f4ab94a55 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:04.165414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a06047-5772-436c-bdb9-cd7f4ab94a55 None admin] PATH_INFO: `/v3/groups/f6a0c06b697c487798ca34365dd85e6f` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:04.166842 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a06047-5772-436c-bdb9-cd7f4ab94a55 None admin] RBAC: Authorizing `identity:get_group(group_id=f6a0c06b697c487798ca34365dd85e6f)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:04.168946 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a06047-5772-436c-bdb9-cd7f4ab94a55 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:04.170858 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 209/403] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Aug 19 01:11:03 2022] GET /identity/v3/groups/f6a0c06b697c487798ca34365dd85e6f => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:04.181225 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a06047-5772-436c-bdb9-cd7f4ab94a55 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:04.254643 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4080ef-d4d8-4433-ac74-8f72d758e209 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:04.265515 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:04.290855 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f3cca-9ede-4bea-ae69-309f0755c999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:04.291819 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f3cca-9ede-4bea-ae69-309f0755c999 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:04.292998 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f3cca-9ede-4bea-ae69-309f0755c999 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:04.293678 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f3cca-9ede-4bea-ae69-309f0755c999 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:04.304831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f3cca-9ede-4bea-ae69-309f0755c999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:04.310431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-5c1f3cca-9ede-4bea-ae69-309f0755c999 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:11:04.310431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:04.310431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:04.310431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:04.310431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:04.310431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:04.310431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:04.310431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:04.310431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:04.310431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:04.310431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:04.310431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:04.310431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:04.310431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:04.310431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:04.310431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:04.311308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:04.311308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:04.311308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:04.311308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:04.311308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:04.311308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:04.311308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:04.311308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:04.311308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:04.311308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:04.311308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:04.311308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:04.311308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:04.311308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:04.311308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:04.311308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:04.312115 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:04.312115 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:04.312115 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:04.312115 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:04.312115 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:04.312115 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:04.312115 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:04.312115 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:04.312115 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:04.312115 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:04.312115 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:11:04.312115 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:04.314711 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 195/404] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:11:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:11:04.319953 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f3cca-9ede-4bea-ae69-309f0755c999 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:04.372267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a06047-5772-436c-bdb9-cd7f4ab94a55 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:04.418518 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451dd4b-2d64-43c5-90ab-7c4f38fdbe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:04.419505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451dd4b-2d64-43c5-90ab-7c4f38fdbe76 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:04.419987 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451dd4b-2d64-43c5-90ab-7c4f38fdbe76 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:04.420482 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451dd4b-2d64-43c5-90ab-7c4f38fdbe76 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:04.421873 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451dd4b-2d64-43c5-90ab-7c4f38fdbe76 None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:04.423511 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451dd4b-2d64-43c5-90ab-7c4f38fdbe76 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:04.425733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 210/405] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:11:04 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:04.426870 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451dd4b-2d64-43c5-90ab-7c4f38fdbe76 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:04.455633 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f3cca-9ede-4bea-ae69-309f0755c999 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:04.475845 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:04.494328 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297eaef2-bccc-480d-9d2d-4ebd7bbec959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:04.494943 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eaef2-bccc-480d-9d2d-4ebd7bbec959 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:04.495248 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eaef2-bccc-480d-9d2d-4ebd7bbec959 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:04.495671 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eaef2-bccc-480d-9d2d-4ebd7bbec959 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:04.500952 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297eaef2-bccc-480d-9d2d-4ebd7bbec959 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:04.500952 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297eaef2-bccc-480d-9d2d-4ebd7bbec959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:04.500952 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297eaef2-bccc-480d-9d2d-4ebd7bbec959 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:04.513185 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 196/406] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:04.514182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297eaef2-bccc-480d-9d2d-4ebd7bbec959 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:04.536366 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451dd4b-2d64-43c5-90ab-7c4f38fdbe76 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:04.551320 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:04.585263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43c22f-a685-4672-b089-14eff8d8f83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:04.586204 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43c22f-a685-4672-b089-14eff8d8f83f None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:04.586690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43c22f-a685-4672-b089-14eff8d8f83f None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:04.587142 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43c22f-a685-4672-b089-14eff8d8f83f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:04.598919 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43c22f-a685-4672-b089-14eff8d8f83f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:04.604063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-ca43c22f-a685-4672-b089-14eff8d8f83f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:11:04.604063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:04.604063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:04.604063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:04.604063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:04.604063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:04.604063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:04.604063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:04.604063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:04.604063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:04.604063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:04.604063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:04.604063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:04.604063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:04.604063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:04.604063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:04.605574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:04.605574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:04.605574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:04.605574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:04.605574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:04.605574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:04.605574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:04.605574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:04.605574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:04.605574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:04.605574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:04.605574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:04.605574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:04.605574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:04.605574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:04.605574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:04.606578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:04.606578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:04.606578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:04.606578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:04.606578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:04.606578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:04.606578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:04.606578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:04.606578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:04.606578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:04.606578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:11:04.606578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:04.609148 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 211/407] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:11:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:04.610146 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43c22f-a685-4672-b089-14eff8d8f83f None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:04.639230 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297eaef2-bccc-480d-9d2d-4ebd7bbec959 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:04.680248 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def10359-cc2c-4717-beb4-a605cbc59c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:04.680951 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def10359-cc2c-4717-beb4-a605cbc59c25 None admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:04.681235 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def10359-cc2c-4717-beb4-a605cbc59c25 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:04.681509 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def10359-cc2c-4717-beb4-a605cbc59c25 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db/groups/f6a0c06b697c487798ca34365dd85e6f/roles/f8c07e35d799437cbb53316acc2fc030` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:04.684912 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def10359-cc2c-4717-beb4-a605cbc59c25 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5da12a5841547c28a9b31bce0ec15db, group_id=f6a0c06b697c487798ca34365dd85e6f, role_id=f8c07e35d799437cbb53316acc2fc030)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:04.686378 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def10359-cc2c-4717-beb4-a605cbc59c25 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:04.722247 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43c22f-a685-4672-b089-14eff8d8f83f None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:04.725828 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:04.771583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 197/408] 10.222.0.82 () {58 vars in 1442 bytes} [Fri Aug 19 01:11:04 2022] PUT /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db/groups/f6a0c06b697c487798ca34365dd85e6f/roles/f8c07e35d799437cbb53316acc2fc030 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:11:04.772755 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def10359-cc2c-4717-beb4-a605cbc59c25 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:04.773102 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f39c1-a6ea-4187-afef-26b2db271b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:04.774948 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f39c1-a6ea-4187-afef-26b2db271b1e None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:04.775434 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f39c1-a6ea-4187-afef-26b2db271b1e None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:04.776408 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f39c1-a6ea-4187-afef-26b2db271b1e None admin] PATH_INFO: `/v3/groups/f6a0c06b697c487798ca34365dd85e6f` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:04.781938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f39c1-a6ea-4187-afef-26b2db271b1e None admin] RBAC: Authorizing `identity:get_group(group_id=f6a0c06b697c487798ca34365dd85e6f)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:04.785426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f39c1-a6ea-4187-afef-26b2db271b1e None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:04.792528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 212/409] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Aug 19 01:11:04 2022] GET /identity/v3/groups/f6a0c06b697c487798ca34365dd85e6f => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:04.796355 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f39c1-a6ea-4187-afef-26b2db271b1e None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:04.990354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:04.995892 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f39c1-a6ea-4187-afef-26b2db271b1e None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:05.014871 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def10359-cc2c-4717-beb4-a605cbc59c25 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:05.065239 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1315549-938f-4577-a549-6ab7af112c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:05.065840 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65569b14-1610-4045-b6bb-4ae7d7ca7d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:05.065962 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1315549-938f-4577-a549-6ab7af112c5e None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:05.066121 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1315549-938f-4577-a549-6ab7af112c5e None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:05.066398 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1315549-938f-4577-a549-6ab7af112c5e None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:05.067071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1315549-938f-4577-a549-6ab7af112c5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:05.067279 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569b14-1610-4045-b6bb-4ae7d7ca7d50 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:05.067374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1315549-938f-4577-a549-6ab7af112c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:05.067806 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569b14-1610-4045-b6bb-4ae7d7ca7d50 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:05.068257 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569b14-1610-4045-b6bb-4ae7d7ca7d50 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:05.068790 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1315549-938f-4577-a549-6ab7af112c5e None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:05.070009 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65569b14-1610-4045-b6bb-4ae7d7ca7d50 None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:05.071451 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65569b14-1610-4045-b6bb-4ae7d7ca7d50 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:05.073463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 213/410] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:11:04 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:05.074691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2e560-a567-49d6-a2b0-66b568cf1c09 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:05.074980 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2e560-a567-49d6-a2b0-66b568cf1c09 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:05.075252 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2e560-a567-49d6-a2b0-66b568cf1c09 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:05.076703 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 214/411] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:05.077972 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 198/412] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:11:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:05.082810 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2e560-a567-49d6-a2b0-66b568cf1c09 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:05.083220 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76a257-2e8e-450d-ab43-ee8f24f93c56 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:05.083485 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76a257-2e8e-450d-ab43-ee8f24f93c56 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:05.083767 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76a257-2e8e-450d-ab43-ee8f24f93c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:05.114249 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-4b76a257-2e8e-450d-ab43-ee8f24f93c56 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:05.116099 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-4b76a257-2e8e-450d-ab43-ee8f24f93c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:05.131006 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:05.193487 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2e560-a567-49d6-a2b0-66b568cf1c09 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:05.194911 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 199/413] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:11:05.201406 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76a257-2e8e-450d-ab43-ee8f24f93c56 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:05.230822 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc232a2-a9b8-446c-89ca-0dbed3871b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:05.231850 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc232a2-a9b8-446c-89ca-0dbed3871b0a None admin] REQUEST_METHOD: `PUT` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:05.232320 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc232a2-a9b8-446c-89ca-0dbed3871b0a None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:05.232866 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc232a2-a9b8-446c-89ca-0dbed3871b0a None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db/groups/f6a0c06b697c487798ca34365dd85e6f/roles/63d0d2b4616248b3aa738ec590e2e4b3` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:05.235270 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc232a2-a9b8-446c-89ca-0dbed3871b0a None admin] RBAC: Authorizing `identity:create_grant(project_id=d5da12a5841547c28a9b31bce0ec15db, group_id=f6a0c06b697c487798ca34365dd85e6f, role_id=63d0d2b4616248b3aa738ec590e2e4b3)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:05.236981 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc232a2-a9b8-446c-89ca-0dbed3871b0a None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:05.309075 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:05.311976 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 215/414] 10.222.0.82 () {58 vars in 1442 bytes} [Fri Aug 19 01:11:05 2022] PUT /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db/groups/f6a0c06b697c487798ca34365dd85e6f/roles/63d0d2b4616248b3aa738ec590e2e4b3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:11:05.327982 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76a257-2e8e-450d-ab43-ee8f24f93c56 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:05.371228 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7de7b1-be64-4096-b4c1-5ba42786bc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:05.372165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7de7b1-be64-4096-b4c1-5ba42786bc34 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:05.372515 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7de7b1-be64-4096-b4c1-5ba42786bc34 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:05.372698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7de7b1-be64-4096-b4c1-5ba42786bc34 None admin] PATH_INFO: `/v3/groups/435eb7c713024662b3d16f21f3d4bd98` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:05.374059 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7de7b1-be64-4096-b4c1-5ba42786bc34 None admin] RBAC: Authorizing `identity:get_group(group_id=435eb7c713024662b3d16f21f3d4bd98)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:05.375541 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7de7b1-be64-4096-b4c1-5ba42786bc34 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:05.377267 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 200/415] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Aug 19 01:11:05 2022] GET /identity/v3/groups/435eb7c713024662b3d16f21f3d4bd98 => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:05.382994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc232a2-a9b8-446c-89ca-0dbed3871b0a None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:05.522483 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:05.526258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc232a2-a9b8-446c-89ca-0dbed3871b0a None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:05.575386 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe297e4-be17-4071-a1f5-7ec537595a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:05.576086 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe297e4-be17-4071-a1f5-7ec537595a1b None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:05.576369 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe297e4-be17-4071-a1f5-7ec537595a1b None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:05.576642 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe297e4-be17-4071-a1f5-7ec537595a1b None admin] PATH_INFO: `/v3/projects/cd377ed4c2f045fc8b576211274579df` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:05.581743 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe297e4-be17-4071-a1f5-7ec537595a1b None admin] RBAC: Authorizing `identity:get_project(project_id=cd377ed4c2f045fc8b576211274579df)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:05.583346 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe297e4-be17-4071-a1f5-7ec537595a1b None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:05.585418 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 216/416] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:11:05 2022] GET /identity/v3/projects/cd377ed4c2f045fc8b576211274579df => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:05.591679 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7de7b1-be64-4096-b4c1-5ba42786bc34 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:05.632822 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe297e4-be17-4071-a1f5-7ec537595a1b None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:05.738189 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7de7b1-be64-4096-b4c1-5ba42786bc34 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:05.804398 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe297e4-be17-4071-a1f5-7ec537595a1b None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:05.812776 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d5d13-9c33-4c35-be1a-d6e560ce9541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:05.813476 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5d13-9c33-4c35-be1a-d6e560ce9541 None admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:05.813756 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5d13-9c33-4c35-be1a-d6e560ce9541 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:05.814035 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5d13-9c33-4c35-be1a-d6e560ce9541 None admin] PATH_INFO: `/v3/projects/cd377ed4c2f045fc8b576211274579df/groups/435eb7c713024662b3d16f21f3d4bd98/roles/fda5389edef24d6baac46d87242d285b` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:05.817933 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d5d13-9c33-4c35-be1a-d6e560ce9541 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd377ed4c2f045fc8b576211274579df, group_id=435eb7c713024662b3d16f21f3d4bd98, role_id=fda5389edef24d6baac46d87242d285b)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:05.819496 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d5d13-9c33-4c35-be1a-d6e560ce9541 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:05.853813 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ec4ef-182a-428c-bc3d-57d9c499f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:05.854998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ec4ef-182a-428c-bc3d-57d9c499f53c None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:05.855546 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ec4ef-182a-428c-bc3d-57d9c499f53c None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:05.855885 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ec4ef-182a-428c-bc3d-57d9c499f53c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:05.871131 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ec4ef-182a-428c-bc3d-57d9c499f53c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:05.876481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-f89ec4ef-182a-428c-bc3d-57d9c499f53c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:11:05.876481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:05.876481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:05.876481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:05.876481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:05.876481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:05.876481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:05.876481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:05.876481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:05.876481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:05.876481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:05.876481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:05.876481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:05.876481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:05.876481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:05.876481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:05.877502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:05.877502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:05.877502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:05.877502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:05.877502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:05.877502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:05.877502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:05.877502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:05.877502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:05.877502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:05.877502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:05.877502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:05.877502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:05.877502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:05.877502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:05.877502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:05.878290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:05.878290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:05.878290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:05.878290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:05.878290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:05.878290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:05.878290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:05.878290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:05.878290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:05.878290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:05.878290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:11:05.878290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:05.878290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 217/417] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:11:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:11:05.883862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ec4ef-182a-428c-bc3d-57d9c499f53c None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:05.912687 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 201/418] 10.222.0.82 () {58 vars in 1442 bytes} [Fri Aug 19 01:11:05 2022] PUT /identity/v3/projects/cd377ed4c2f045fc8b576211274579df/groups/435eb7c713024662b3d16f21f3d4bd98/roles/fda5389edef24d6baac46d87242d285b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:11:05.923735 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:06.015208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ec4ef-182a-428c-bc3d-57d9c499f53c None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:06.065947 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9d0c0-3ccf-420e-86cf-ab0e61a6ba2c None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:06.066266 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9d0c0-3ccf-420e-86cf-ab0e61a6ba2c None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:06.066519 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9d0c0-3ccf-420e-86cf-ab0e61a6ba2c None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:06.068303 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 202/419] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:11:06.074560 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3c4da-674e-4e5d-9bf3-021bfc99dda1 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:06.074857 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3c4da-674e-4e5d-9bf3-021bfc99dda1 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:06.075119 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3c4da-674e-4e5d-9bf3-021bfc99dda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:06.077692 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0972453-5f18-4d6c-aa0f-84e47c94247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:06.078494 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0972453-5f18-4d6c-aa0f-84e47c94247d None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:06.078781 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0972453-5f18-4d6c-aa0f-84e47c94247d None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:06.079053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0972453-5f18-4d6c-aa0f-84e47c94247d None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:06.079728 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0972453-5f18-4d6c-aa0f-84e47c94247d None admin] RBAC: Adding query filter params (name=member) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:06.080027 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0972453-5f18-4d6c-aa0f-84e47c94247d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:06.081457 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0972453-5f18-4d6c-aa0f-84e47c94247d None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:06.094934 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-fbe3c4da-674e-4e5d-9bf3-021bfc99dda1 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:06.096156 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-fbe3c4da-674e-4e5d-9bf3-021bfc99dda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:06.096581 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 218/420] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:11:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:06.102412 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0972453-5f18-4d6c-aa0f-84e47c94247d None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:06.106664 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:06.211302 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 203/421] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:11:06.255476 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:06.266049 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0972453-5f18-4d6c-aa0f-84e47c94247d None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:06.300116 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9cc95-7e77-4d75-b33f-2525a9571f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:06.300736 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9cc95-7e77-4d75-b33f-2525a9571f94 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:06.301130 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9cc95-7e77-4d75-b33f-2525a9571f94 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:06.301403 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9cc95-7e77-4d75-b33f-2525a9571f94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:06.388766 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9cc95-7e77-4d75-b33f-2525a9571f94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:06.390269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9cc95-7e77-4d75-b33f-2525a9571f94 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:06.482830 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:06.493397 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 219/422] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:11:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 01:11:06.498832 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3c4da-674e-4e5d-9bf3-021bfc99dda1 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:06.583121 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9cc95-7e77-4d75-b33f-2525a9571f94 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:06.655133 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3c4da-674e-4e5d-9bf3-021bfc99dda1 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:06.695035 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43723b1b-4ff7-491d-a5b1-05a8d9052630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:06.695892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43723b1b-4ff7-491d-a5b1-05a8d9052630 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:06.696173 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43723b1b-4ff7-491d-a5b1-05a8d9052630 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:06.696448 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43723b1b-4ff7-491d-a5b1-05a8d9052630 None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:06.697609 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43723b1b-4ff7-491d-a5b1-05a8d9052630 None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:06.700019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43723b1b-4ff7-491d-a5b1-05a8d9052630 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:06.702104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 204/423] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:11:06 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:06.707211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43723b1b-4ff7-491d-a5b1-05a8d9052630 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:06.714611 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9cc95-7e77-4d75-b33f-2525a9571f94 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:06.731717 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:06.767812 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e88d9-3476-48a9-8883-ebec5242d965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:06.768454 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e88d9-3476-48a9-8883-ebec5242d965 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:06.768733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e88d9-3476-48a9-8883-ebec5242d965 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:06.769039 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e88d9-3476-48a9-8883-ebec5242d965 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:06.781198 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e88d9-3476-48a9-8883-ebec5242d965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:06.786032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-546e88d9-3476-48a9-8883-ebec5242d965 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:11:06.786032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:06.786032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:06.786032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:06.786032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:06.786032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:06.786032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:06.786032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:06.786032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:06.786032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:06.786032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:06.786032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:06.786032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:06.786032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:06.786032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:06.786032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:06.786942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:06.786942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:06.786942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:06.786942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:06.786942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:06.786942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:06.786942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:06.786942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:06.786942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:06.786942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:06.786942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:06.786942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:06.786942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:06.786942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:06.786942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:06.786942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:06.787723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:06.787723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:06.787723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:06.787723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:06.787723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:06.787723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:06.787723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:06.787723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:06.787723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:06.787723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:06.787723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:11:06.787723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:06.787723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 220/424] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:11:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:06.793109 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e88d9-3476-48a9-8883-ebec5242d965 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:06.867723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:06.883936 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43723b1b-4ff7-491d-a5b1-05a8d9052630 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:06.923509 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e88d9-3476-48a9-8883-ebec5242d965 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:06.960032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb280c-aa06-4d81-bc04-e8a91e7d9465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:06.961541 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7ec93-ccff-4503-9355-71584c57bc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:06.961947 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb280c-aa06-4d81-bc04-e8a91e7d9465 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:06.962417 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb280c-aa06-4d81-bc04-e8a91e7d9465 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:06.962876 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb280c-aa06-4d81-bc04-e8a91e7d9465 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:06.964742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7ec93-ccff-4503-9355-71584c57bc1f None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:06.965252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7ec93-ccff-4503-9355-71584c57bc1f None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:06.965705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7ec93-ccff-4503-9355-71584c57bc1f None admin] PATH_INFO: `/v3/groups/f6a0c06b697c487798ca34365dd85e6f` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:06.966259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb280c-aa06-4d81-bc04-e8a91e7d9465 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:06.967313 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb280c-aa06-4d81-bc04-e8a91e7d9465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:06.968223 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7ec93-ccff-4503-9355-71584c57bc1f None admin] RBAC: Authorizing `identity:get_group(group_id=f6a0c06b697c487798ca34365dd85e6f)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:06.969840 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb280c-aa06-4d81-bc04-e8a91e7d9465 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:06.971484 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7ec93-ccff-4503-9355-71584c57bc1f None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:06.976892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 205/425] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Aug 19 01:11:06 2022] GET /identity/v3/groups/f6a0c06b697c487798ca34365dd85e6f => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:06.981319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7ec93-ccff-4503-9355-71584c57bc1f None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:06.988532 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 221/426] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:06.994315 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb280c-aa06-4d81-bc04-e8a91e7d9465 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:07.109223 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:07.149068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7ec93-ccff-4503-9355-71584c57bc1f None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:07.224901 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a38aa-07c7-44b1-b234-841db95d3d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:07.225437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a38aa-07c7-44b1-b234-841db95d3d69 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:07.225718 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a38aa-07c7-44b1-b234-841db95d3d69 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:07.225987 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a38aa-07c7-44b1-b234-841db95d3d69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:07.226871 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a38aa-07c7-44b1-b234-841db95d3d69 None admin] RBAC: Adding query filter params (group.id=f6a0c06b697c487798ca34365dd85e6f, role.id=f8c07e35d799437cbb53316acc2fc030, scope.project.id=926d0bea317c4b8a9c79dcb750be0c31) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:07.227440 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a38aa-07c7-44b1-b234-841db95d3d69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:07.228911 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a38aa-07c7-44b1-b234-841db95d3d69 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:07.229881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb280c-aa06-4d81-bc04-e8a91e7d9465 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:07.236297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 206/427] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Aug 19 01:11:06 2022] GET /identity/v3/role_assignments?group.id=f6a0c06b697c487798ca34365dd85e6f&scope.project.id=926d0bea317c4b8a9c79dcb750be0c31&role.id=f8c07e35d799437cbb53316acc2fc030 => generated 611 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:07.251467 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:07.275474 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b162b-fbf6-4d7f-a390-1148b97a8fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:07.276356 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b162b-fbf6-4d7f-a390-1148b97a8fb8 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:07.276817 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b162b-fbf6-4d7f-a390-1148b97a8fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:07.277252 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b162b-fbf6-4d7f-a390-1148b97a8fb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:07.367454 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b162b-fbf6-4d7f-a390-1148b97a8fb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:07.369226 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b162b-fbf6-4d7f-a390-1148b97a8fb8 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:07.486678 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 222/428] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:11:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 01:11:07.494047 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a38aa-07c7-44b1-b234-841db95d3d69 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:07.622976 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c5dca-b005-4c46-84f7-f9187aeef795 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:07.623548 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c5dca-b005-4c46-84f7-f9187aeef795 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:07.623995 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c5dca-b005-4c46-84f7-f9187aeef795 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:07.626932 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 223/429] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:11:07.630271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a38aa-07c7-44b1-b234-841db95d3d69 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:07.632698 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addfdee-8bb8-4e56-a51b-d14286195fa3 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:07.633200 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addfdee-8bb8-4e56-a51b-d14286195fa3 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:07.633656 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addfdee-8bb8-4e56-a51b-d14286195fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:07.655105 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-4addfdee-8bb8-4e56-a51b-d14286195fa3 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:07.656666 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-4addfdee-8bb8-4e56-a51b-d14286195fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:07.666955 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50927634-c308-43ba-8c0c-b4018bc01c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:07.667430 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:07.667647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50927634-c308-43ba-8c0c-b4018bc01c73 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:07.668151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50927634-c308-43ba-8c0c-b4018bc01c73 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:07.668775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50927634-c308-43ba-8c0c-b4018bc01c73 None admin] PATH_INFO: `/v3/projects/926d0bea317c4b8a9c79dcb750be0c31` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:07.669736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50927634-c308-43ba-8c0c-b4018bc01c73 None admin] RBAC: Authorizing `identity:get_project(project_id=926d0bea317c4b8a9c79dcb750be0c31)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:07.671370 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50927634-c308-43ba-8c0c-b4018bc01c73 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:07.673272 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 207/430] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:11:07 2022] GET /identity/v3/projects/926d0bea317c4b8a9c79dcb750be0c31 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:07.679132 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50927634-c308-43ba-8c0c-b4018bc01c73 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:07.705423 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:07.743682 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 224/431] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:07.796418 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50927634-c308-43ba-8c0c-b4018bc01c73 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:07.831666 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b49b8-f661-48e5-a140-6aea3f0c28fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:07.832294 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b49b8-f661-48e5-a140-6aea3f0c28fc None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:07.832568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b49b8-f661-48e5-a140-6aea3f0c28fc None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:07.832833 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b49b8-f661-48e5-a140-6aea3f0c28fc None admin] PATH_INFO: `/v3/groups/f6a0c06b697c487798ca34365dd85e6f` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:07.833962 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b49b8-f661-48e5-a140-6aea3f0c28fc None admin] RBAC: Authorizing `identity:get_group(group_id=f6a0c06b697c487798ca34365dd85e6f)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:07.835399 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b49b8-f661-48e5-a140-6aea3f0c28fc None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:07.837457 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 208/432] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Aug 19 01:11:07 2022] GET /identity/v3/groups/f6a0c06b697c487798ca34365dd85e6f => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:07.843628 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addfdee-8bb8-4e56-a51b-d14286195fa3 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:07.955995 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addfdee-8bb8-4e56-a51b-d14286195fa3 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:07.991140 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88ffc7-2634-4bbd-997c-0800f6a91f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:07.991835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88ffc7-2634-4bbd-997c-0800f6a91f88 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:07.992113 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88ffc7-2634-4bbd-997c-0800f6a91f88 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:07.992418 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88ffc7-2634-4bbd-997c-0800f6a91f88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:07.993181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88ffc7-2634-4bbd-997c-0800f6a91f88 None admin] RBAC: Adding query filter params (group.id=f6a0c06b697c487798ca34365dd85e6f, role.id=63d0d2b4616248b3aa738ec590e2e4b3, scope.project.id=926d0bea317c4b8a9c79dcb750be0c31) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:07.993486 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88ffc7-2634-4bbd-997c-0800f6a91f88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:07.994976 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88ffc7-2634-4bbd-997c-0800f6a91f88 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:08.001789 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 225/433] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Aug 19 01:11:07 2022] GET /identity/v3/role_assignments?group.id=f6a0c06b697c487798ca34365dd85e6f&scope.project.id=926d0bea317c4b8a9c79dcb750be0c31&role.id=63d0d2b4616248b3aa738ec590e2e4b3 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:08.103602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a91e1b-981d-458e-8a51-5e61a6541382 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:08.104093 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a91e1b-981d-458e-8a51-5e61a6541382 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:08.104168 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a91e1b-981d-458e-8a51-5e61a6541382 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:08.106717 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 209/434] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:08.112039 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981465a-56d5-4528-937a-a5411140c501 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:08.112360 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981465a-56d5-4528-937a-a5411140c501 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:08.112592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981465a-56d5-4528-937a-a5411140c501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:08.129529 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:08.140714 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a91e1b-981d-458e-8a51-5e61a6541382 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:08.141312 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-f981465a-56d5-4528-937a-a5411140c501 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:08.142536 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-f981465a-56d5-4528-937a-a5411140c501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:08.231353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:08.240020 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 226/435] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:08.256233 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a91e1b-981d-458e-8a51-5e61a6541382 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:08.291800 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50e705-80e5-428f-ad74-5879b69b4c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:08.293034 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50e705-80e5-428f-ad74-5879b69b4c22 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:08.294361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50e705-80e5-428f-ad74-5879b69b4c22 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:08.294637 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50e705-80e5-428f-ad74-5879b69b4c22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:08.305353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50e705-80e5-428f-ad74-5879b69b4c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:08.311134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-ad50e705-80e5-428f-ad74-5879b69b4c22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:11:08.311134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:08.311134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:08.311134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:08.311134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:08.311134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:08.311134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:08.311134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:08.311134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:08.311134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:08.311134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:08.311134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:08.311134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:08.311134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:08.311134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:08.311134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:08.312030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:08.312030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:08.312030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:08.312030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:08.312030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:08.312030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:08.312030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:08.312030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:08.312030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:08.312030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:08.312030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:08.312030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:08.312030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:08.312030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:08.312030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:08.312030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:08.312840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:08.312840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:08.312840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:08.312840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:08.312840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:08.312840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:08.312840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:08.312840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:08.312840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:08.312840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:08.312840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 01:11:08.312840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:08.317087 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 210/436] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:11:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:11:08.318488 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981465a-56d5-4528-937a-a5411140c501 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:08.437595 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981465a-56d5-4528-937a-a5411140c501 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:08.477653 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6266b-5248-42bb-ad45-da5e46a5b9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:08.478274 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6266b-5248-42bb-ad45-da5e46a5b9e4 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:08.478577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6266b-5248-42bb-ad45-da5e46a5b9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:08.478852 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6266b-5248-42bb-ad45-da5e46a5b9e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:08.479567 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6266b-5248-42bb-ad45-da5e46a5b9e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:08.479876 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6266b-5248-42bb-ad45-da5e46a5b9e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:08.481276 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6266b-5248-42bb-ad45-da5e46a5b9e4 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:08.484085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:08.490777 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 227/437] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:11:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:08.497035 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50e705-80e5-428f-ad74-5879b69b4c22 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:08.585909 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6266b-5248-42bb-ad45-da5e46a5b9e4 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:08.635445 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50e705-80e5-428f-ad74-5879b69b4c22 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:08.679806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baef749-13e7-4225-870c-d8c0fbcd136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:08.680750 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef749-13e7-4225-870c-d8c0fbcd136a None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:08.681159 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef749-13e7-4225-870c-d8c0fbcd136a None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:08.681430 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef749-13e7-4225-870c-d8c0fbcd136a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:08.693286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:08.716640 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6266b-5248-42bb-ad45-da5e46a5b9e4 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:08.752191 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb958e8-dafc-4826-8efd-95c51498b8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:08.753146 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb958e8-dafc-4826-8efd-95c51498b8a4 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:08.753495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb958e8-dafc-4826-8efd-95c51498b8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:08.753767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb958e8-dafc-4826-8efd-95c51498b8a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:08.756652 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baef749-13e7-4225-870c-d8c0fbcd136a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:08.758140 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baef749-13e7-4225-870c-d8c0fbcd136a None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:08.764837 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb958e8-dafc-4826-8efd-95c51498b8a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:08.770081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-fbb958e8-dafc-4826-8efd-95c51498b8a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:11:08.770081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:08.770081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:08.770081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:08.770081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:08.770081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:08.770081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:08.770081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:08.770081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:08.770081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:08.770081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:08.770081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:08.770081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:08.770081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:08.770081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:08.770081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:08.770962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:08.770962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:08.770962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:08.770962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:08.770962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:08.770962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:08.770962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:08.770962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:08.770962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:08.770962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:08.770962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:08.770962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:08.770962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:08.770962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:08.770962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:08.770962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:08.772016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:08.772016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:08.772016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:08.772016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:08.772016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:08.772016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:08.772016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:08.772016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:08.772016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:08.772016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:08.772016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 01:11:08.772016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:08.772016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 228/438] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:11:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:11:08.777407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb958e8-dafc-4826-8efd-95c51498b8a4 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:08.839074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:08.866074 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 211/439] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:11:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:11:08.867403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5826-f4b8-47f1-a1f4-02eb39cfc2a4 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:08.867697 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5826-f4b8-47f1-a1f4-02eb39cfc2a4 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:08.867972 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5826-f4b8-47f1-a1f4-02eb39cfc2a4 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:08.869395 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 212/440] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:08.872423 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa5826-f4b8-47f1-a1f4-02eb39cfc2a4 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:08.881939 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb958e8-dafc-4826-8efd-95c51498b8a4 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:08.913642 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:08.917514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b0153-6a33-4192-a70e-0131e850dc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:08.918457 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b0153-6a33-4192-a70e-0131e850dc71 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:08.918737 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b0153-6a33-4192-a70e-0131e850dc71 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:08.919003 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b0153-6a33-4192-a70e-0131e850dc71 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:08.919661 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b0153-6a33-4192-a70e-0131e850dc71 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:08.919963 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b0153-6a33-4192-a70e-0131e850dc71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:08.921394 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b0153-6a33-4192-a70e-0131e850dc71 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:08.929711 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 229/441] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:08.930861 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17299421-2752-46d3-9368-8fb673bf0ea8 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:08.932344 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17299421-2752-46d3-9368-8fb673bf0ea8 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:08.932344 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17299421-2752-46d3-9368-8fb673bf0ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:08.949946 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-17299421-2752-46d3-9368-8fb673bf0ea8 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:08.951147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-17299421-2752-46d3-9368-8fb673bf0ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:08.975015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa5826-f4b8-47f1-a1f4-02eb39cfc2a4 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:09.008184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507a9c0-0f8d-413b-9645-94306927f514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:09.008804 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507a9c0-0f8d-413b-9645-94306927f514 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:09.009105 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507a9c0-0f8d-413b-9645-94306927f514 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:09.009372 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507a9c0-0f8d-413b-9645-94306927f514 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:09.010465 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507a9c0-0f8d-413b-9645-94306927f514 None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:09.012417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507a9c0-0f8d-413b-9645-94306927f514 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:09.014046 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 213/442] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:11:08 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:09.014790 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507a9c0-0f8d-413b-9645-94306927f514 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:09.017175 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 230/443] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:09.019555 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17299421-2752-46d3-9368-8fb673bf0ea8 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:09.080549 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:09.123601 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507a9c0-0f8d-413b-9645-94306927f514 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:09.131473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:09.134538 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17299421-2752-46d3-9368-8fb673bf0ea8 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:09.159247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ac326-22d0-43e0-b730-4b82fa996a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:09.159872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ac326-22d0-43e0-b730-4b82fa996a81 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:09.160147 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ac326-22d0-43e0-b730-4b82fa996a81 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:09.160413 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ac326-22d0-43e0-b730-4b82fa996a81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:09.172569 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9d254-503c-4b61-8392-979db254b596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:09.173233 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d254-503c-4b61-8392-979db254b596 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:09.173522 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d254-503c-4b61-8392-979db254b596 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:09.173791 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d254-503c-4b61-8392-979db254b596 None admin] PATH_INFO: `/v3/groups/f6a0c06b697c487798ca34365dd85e6f` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:09.174907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9d254-503c-4b61-8392-979db254b596 None admin] RBAC: Authorizing `identity:get_group(group_id=f6a0c06b697c487798ca34365dd85e6f)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:09.176583 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9d254-503c-4b61-8392-979db254b596 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:09.182873 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 231/444] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Aug 19 01:11:09 2022] GET /identity/v3/groups/f6a0c06b697c487798ca34365dd85e6f => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:09.183847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9d254-503c-4b61-8392-979db254b596 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:09.235204 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ac326-22d0-43e0-b730-4b82fa996a81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:09.236686 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ac326-22d0-43e0-b730-4b82fa996a81 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:09.291210 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9d254-503c-4b61-8392-979db254b596 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:09.311151 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:09.330111 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a649cf-e428-437a-8657-6164ab56bb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:09.331100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a649cf-e428-437a-8657-6164ab56bb48 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:09.331578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a649cf-e428-437a-8657-6164ab56bb48 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:09.332047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a649cf-e428-437a-8657-6164ab56bb48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:09.333181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a649cf-e428-437a-8657-6164ab56bb48 None admin] RBAC: Adding query filter params (group.id=f6a0c06b697c487798ca34365dd85e6f, role.id=f8c07e35d799437cbb53316acc2fc030, scope.project.id=d5da12a5841547c28a9b31bce0ec15db) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:09.333794 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a649cf-e428-437a-8657-6164ab56bb48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:09.335539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a649cf-e428-437a-8657-6164ab56bb48 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:09.340370 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 214/445] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:11:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:11:09.342531 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 232/446] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Aug 19 01:11:09 2022] GET /identity/v3/role_assignments?group.id=f6a0c06b697c487798ca34365dd85e6f&scope.project.id=d5da12a5841547c28a9b31bce0ec15db&role.id=f8c07e35d799437cbb53316acc2fc030 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:09.350094 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a649cf-e428-437a-8657-6164ab56bb48 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:09.350305 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ac326-22d0-43e0-b730-4b82fa996a81 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:09.360696 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:09.466487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ac326-22d0-43e0-b730-4b82fa996a81 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:09.468549 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a649cf-e428-437a-8657-6164ab56bb48 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:09.504180 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122caf8-7114-42b9-9ce7-960aeef23805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:09.504830 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122caf8-7114-42b9-9ce7-960aeef23805 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:09.505136 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122caf8-7114-42b9-9ce7-960aeef23805 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:09.505407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122caf8-7114-42b9-9ce7-960aeef23805 None admin] PATH_INFO: `/v3/projects/d5da12a5841547c28a9b31bce0ec15db` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:09.506544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122caf8-7114-42b9-9ce7-960aeef23805 None admin] RBAC: Authorizing `identity:get_project(project_id=d5da12a5841547c28a9b31bce0ec15db)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:09.507087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbef32-b58f-4cf2-b61f-97213c1232d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:09.507723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbef32-b58f-4cf2-b61f-97213c1232d2 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:09.508000 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbef32-b58f-4cf2-b61f-97213c1232d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:09.508094 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122caf8-7114-42b9-9ce7-960aeef23805 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:09.508269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbef32-b58f-4cf2-b61f-97213c1232d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:09.515004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 215/447] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:11:09 2022] GET /identity/v3/projects/d5da12a5841547c28a9b31bce0ec15db => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:09.516830 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122caf8-7114-42b9-9ce7-960aeef23805 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:09.525366 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbef32-b58f-4cf2-b61f-97213c1232d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:09.531269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-80fbef32-b58f-4cf2-b61f-97213c1232d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:11:09.531269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:09.531269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:09.531269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:09.531269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:09.531269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:09.531269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:09.531269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:09.531269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:09.531269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:09.531269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:09.531269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:09.531269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:09.531269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:09.531269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:09.531269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:09.532201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:09.532201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:09.532201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:09.532201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:09.532201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:09.532201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:09.532201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:09.532201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:09.532201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:09.532201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:09.532201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:09.532201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:09.532201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:09.532201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:09.532201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:09.532201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:09.533280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:09.533280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:09.533280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:09.533280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:09.533280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:09.533280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:09.533280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:09.533280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:09.533280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:09.533280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:09.533280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:11:09.533280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:09.533280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 233/448] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:11:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:09.539406 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbef32-b58f-4cf2-b61f-97213c1232d2 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:09.595586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:09.611381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:09.641405 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122caf8-7114-42b9-9ce7-960aeef23805 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:09.673796 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbef32-b58f-4cf2-b61f-97213c1232d2 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:09.683791 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93b91f-9f04-4624-a325-17bc472adfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:09.684877 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93b91f-9f04-4624-a325-17bc472adfee None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:09.687807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93b91f-9f04-4624-a325-17bc472adfee None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:09.687807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93b91f-9f04-4624-a325-17bc472adfee None admin] PATH_INFO: `/v3/groups/f6a0c06b697c487798ca34365dd85e6f` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:09.687807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93b91f-9f04-4624-a325-17bc472adfee None admin] RBAC: Authorizing `identity:get_group(group_id=f6a0c06b697c487798ca34365dd85e6f)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:09.688517 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93b91f-9f04-4624-a325-17bc472adfee None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:09.690973 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 216/449] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Aug 19 01:11:09 2022] GET /identity/v3/groups/f6a0c06b697c487798ca34365dd85e6f => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:09.697968 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93b91f-9f04-4624-a325-17bc472adfee None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:09.713555 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5d800-967f-4c47-8954-536880e3249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:09.714644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5d800-967f-4c47-8954-536880e3249d None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:09.714922 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5d800-967f-4c47-8954-536880e3249d None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:09.715215 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5d800-967f-4c47-8954-536880e3249d None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:09.715850 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5d800-967f-4c47-8954-536880e3249d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:09.716144 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5d800-967f-4c47-8954-536880e3249d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:09.717597 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5d800-967f-4c47-8954-536880e3249d None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:09.725996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 234/450] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:11:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:09.731978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5d800-967f-4c47-8954-536880e3249d None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:09.810248 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93b91f-9f04-4624-a325-17bc472adfee None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:09.834725 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5d800-967f-4c47-8954-536880e3249d None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:09.837012 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:09.842984 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e3049-a7f8-4d66-879c-6e1440456a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:09.843585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e3049-a7f8-4d66-879c-6e1440456a19 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:09.843859 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e3049-a7f8-4d66-879c-6e1440456a19 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:09.844126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e3049-a7f8-4d66-879c-6e1440456a19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:09.844842 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e3049-a7f8-4d66-879c-6e1440456a19 None admin] RBAC: Adding query filter params (group.id=f6a0c06b697c487798ca34365dd85e6f, role.id=63d0d2b4616248b3aa738ec590e2e4b3, scope.project.id=d5da12a5841547c28a9b31bce0ec15db) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:09.845182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e3049-a7f8-4d66-879c-6e1440456a19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:09.846615 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e3049-a7f8-4d66-879c-6e1440456a19 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:09.852360 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 217/451] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Aug 19 01:11:09 2022] GET /identity/v3/role_assignments?group.id=f6a0c06b697c487798ca34365dd85e6f&scope.project.id=d5da12a5841547c28a9b31bce0ec15db&role.id=63d0d2b4616248b3aa738ec590e2e4b3 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:09.869842 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45cdfe-f113-4151-b3c5-1f5a900dd806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:09.871017 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45cdfe-f113-4151-b3c5-1f5a900dd806 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:09.871285 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45cdfe-f113-4151-b3c5-1f5a900dd806 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:09.871550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45cdfe-f113-4151-b3c5-1f5a900dd806 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:09.951622 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45cdfe-f113-4151-b3c5-1f5a900dd806 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:09.953149 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45cdfe-f113-4151-b3c5-1f5a900dd806 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:10.058091 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 235/452] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:11:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 01:11:10.063809 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e3049-a7f8-4d66-879c-6e1440456a19 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:10.075435 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:10.169264 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e3049-a7f8-4d66-879c-6e1440456a19 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:10.202965 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7e57e-3f06-412a-a7c6-b56d3ddd75ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:10.203591 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7e57e-3f06-412a-a7c6-b56d3ddd75ce None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:10.203864 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7e57e-3f06-412a-a7c6-b56d3ddd75ce None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:10.204131 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7e57e-3f06-412a-a7c6-b56d3ddd75ce None admin] PATH_INFO: `/v3/projects/cd377ed4c2f045fc8b576211274579df` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:10.205259 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7e57e-3f06-412a-a7c6-b56d3ddd75ce None admin] RBAC: Authorizing `identity:get_project(project_id=cd377ed4c2f045fc8b576211274579df)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:10.206717 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7e57e-3f06-412a-a7c6-b56d3ddd75ce None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:10.208313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 218/453] 10.222.0.82 () {56 vars in 1186 bytes} [Fri Aug 19 01:11:10 2022] GET /identity/v3/projects/cd377ed4c2f045fc8b576211274579df => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:10.214927 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45cdfe-f113-4151-b3c5-1f5a900dd806 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:10.218846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:10.313785 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45cdfe-f113-4151-b3c5-1f5a900dd806 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:10.346331 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5727f-508f-4119-993e-77b6cee761c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:10.346944 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5727f-508f-4119-993e-77b6cee761c7 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:10.347222 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5727f-508f-4119-993e-77b6cee761c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:10.347491 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5727f-508f-4119-993e-77b6cee761c7 None admin] PATH_INFO: `/v3/groups/435eb7c713024662b3d16f21f3d4bd98` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:10.348581 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5727f-508f-4119-993e-77b6cee761c7 None admin] RBAC: Authorizing `identity:get_group(group_id=435eb7c713024662b3d16f21f3d4bd98)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:10.350055 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5727f-508f-4119-993e-77b6cee761c7 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:10.351587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 236/454] 10.222.0.82 () {56 vars in 1180 bytes} [Fri Aug 19 01:11:10 2022] GET /identity/v3/groups/435eb7c713024662b3d16f21f3d4bd98 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:10.358044 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7e57e-3f06-412a-a7c6-b56d3ddd75ce None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:10.431695 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:10.455581 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7e57e-3f06-412a-a7c6-b56d3ddd75ce None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:10.488234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb8bd9-b35a-4f5b-9873-d96d9d3b2b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:10.488824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb8bd9-b35a-4f5b-9873-d96d9d3b2b3b None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:10.489129 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb8bd9-b35a-4f5b-9873-d96d9d3b2b3b None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:10.489396 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb8bd9-b35a-4f5b-9873-d96d9d3b2b3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:10.490107 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb8bd9-b35a-4f5b-9873-d96d9d3b2b3b None admin] RBAC: Adding query filter params (group.id=435eb7c713024662b3d16f21f3d4bd98, role.id=fda5389edef24d6baac46d87242d285b, scope.project.id=cd377ed4c2f045fc8b576211274579df) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:10.490412 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb8bd9-b35a-4f5b-9873-d96d9d3b2b3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:10.491828 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb8bd9-b35a-4f5b-9873-d96d9d3b2b3b None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:10.497630 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 219/455] 10.222.0.82 () {56 vars in 1376 bytes} [Fri Aug 19 01:11:10 2022] GET /identity/v3/role_assignments?group.id=435eb7c713024662b3d16f21f3d4bd98&scope.project.id=cd377ed4c2f045fc8b576211274579df&role.id=fda5389edef24d6baac46d87242d285b => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:12.992123 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3786e79-2a38-486a-8747-65771282f0f2 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:12.992646 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3786e79-2a38-486a-8747-65771282f0f2 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:12.992646 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3786e79-2a38-486a-8747-65771282f0f2 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:12.994266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 237/456] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:13.000414 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce673f-40ac-47d7-9e90-28da6369f7e2 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:13.001259 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce673f-40ac-47d7-9e90-28da6369f7e2 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:13.001786 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce673f-40ac-47d7-9e90-28da6369f7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:13.021037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-e6ce673f-40ac-47d7-9e90-28da6369f7e2 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:13.022810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-e6ce673f-40ac-47d7-9e90-28da6369f7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:13.100673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 220/457] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:13.243450 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604cee0-2965-47e5-add8-861ec860d3a8 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:13.244058 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604cee0-2965-47e5-add8-861ec860d3a8 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:13.244529 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604cee0-2965-47e5-add8-861ec860d3a8 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:13.246709 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 238/458] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:13.252227 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759a57f-97e5-404e-a2d0-aeb429de8565 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:13.252519 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759a57f-97e5-404e-a2d0-aeb429de8565 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:13.252792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759a57f-97e5-404e-a2d0-aeb429de8565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:13.271756 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-6759a57f-97e5-404e-a2d0-aeb429de8565 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:13.272977 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-6759a57f-97e5-404e-a2d0-aeb429de8565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:13.343722 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:13.349975 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 221/459] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:13.446855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604cee0-2965-47e5-add8-861ec860d3a8 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:13.494767 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1745604-5a08-41f7-a5ca-abc2fd9fffdc None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:13.495072 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1745604-5a08-41f7-a5ca-abc2fd9fffdc None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:13.495256 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1745604-5a08-41f7-a5ca-abc2fd9fffdc None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:13.496959 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 222/460] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:11:13.501802 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b394e1a-5742-49ee-b81e-24bf95039d21 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:13.502081 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b394e1a-5742-49ee-b81e-24bf95039d21 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:13.502407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b394e1a-5742-49ee-b81e-24bf95039d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:13.522103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-4b394e1a-5742-49ee-b81e-24bf95039d21 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:13.523337 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-4b394e1a-5742-49ee-b81e-24bf95039d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:13.525799 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:13.564112 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604cee0-2965-47e5-add8-861ec860d3a8 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:13.604290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3895e-c11e-4951-a072-90d9e4572257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:13.605985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3895e-c11e-4951-a072-90d9e4572257 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:13.607232 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3895e-c11e-4951-a072-90d9e4572257 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:13.608687 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3895e-c11e-4951-a072-90d9e4572257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:13.616893 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 223/461] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:11:13.629452 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3895e-c11e-4951-a072-90d9e4572257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:13.631314 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3895e-c11e-4951-a072-90d9e4572257 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:13.647551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-92d3895e-c11e-4951-a072-90d9e4572257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:13.647551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:13.647551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:13.647551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:13.647551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:13.647551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:13.647551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:13.647551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:13.647551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:13.647551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:13.647551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:13.647551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:13.647551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:13.647551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:13.647551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:13.647551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:13.649150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:13.650017 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:13.650017 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:13.650017 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:13.651447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 239/462] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:13.657319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b394e1a-5742-49ee-b81e-24bf95039d21 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:13.707486 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3895e-c11e-4951-a072-90d9e4572257 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:13.784615 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b394e1a-5742-49ee-b81e-24bf95039d21 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:13.821297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:13.822112 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f08eb7-7e72-4d3e-b1ca-b4c0fd6be97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:13.822894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f08eb7-7e72-4d3e-b1ca-b4c0fd6be97b None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:13.823336 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f08eb7-7e72-4d3e-b1ca-b4c0fd6be97b None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:13.823709 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f08eb7-7e72-4d3e-b1ca-b4c0fd6be97b None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:13.824465 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f08eb7-7e72-4d3e-b1ca-b4c0fd6be97b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:13.824892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f08eb7-7e72-4d3e-b1ca-b4c0fd6be97b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:13.825440 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3895e-c11e-4951-a072-90d9e4572257 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:13.826537 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f08eb7-7e72-4d3e-b1ca-b4c0fd6be97b None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:13.841563 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 224/463] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:13.845908 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f08eb7-7e72-4d3e-b1ca-b4c0fd6be97b None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:13.854282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:13.865474 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508306d3-cfee-489a-83c1-a7100ddee74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:13.866104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508306d3-cfee-489a-83c1-a7100ddee74c None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:13.866385 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508306d3-cfee-489a-83c1-a7100ddee74c None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:13.866869 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508306d3-cfee-489a-83c1-a7100ddee74c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:13.877745 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508306d3-cfee-489a-83c1-a7100ddee74c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:13.879183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508306d3-cfee-489a-83c1-a7100ddee74c None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:13.894665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-508306d3-cfee-489a-83c1-a7100ddee74c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:13.894665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:13.894665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:13.894665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:13.894665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:13.894665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:13.894665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:13.894665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:13.894665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:13.894665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:13.894665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:13.894665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:13.894665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:13.894665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:13.894665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:13.894665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:13.895603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:13.896715 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:13.896715 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:13.896715 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:13.896715 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 240/464] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:13.897558 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2ff35-b62f-4b80-b9e0-66f52edcbd53 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:13.897558 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2ff35-b62f-4b80-b9e0-66f52edcbd53 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:13.897738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2ff35-b62f-4b80-b9e0-66f52edcbd53 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:13.899109 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 241/465] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:13.904372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2ff35-b62f-4b80-b9e0-66f52edcbd53 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:13.960486 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f08eb7-7e72-4d3e-b1ca-b4c0fd6be97b None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:13.993541 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e77c0-5555-4c20-81dc-f61e21a7d121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:13.994141 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e77c0-5555-4c20-81dc-f61e21a7d121 None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:13.994417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e77c0-5555-4c20-81dc-f61e21a7d121 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:13.994686 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e77c0-5555-4c20-81dc-f61e21a7d121 None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:13.995347 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e77c0-5555-4c20-81dc-f61e21a7d121 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:13.996766 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e77c0-5555-4c20-81dc-f61e21a7d121 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:14.009774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2ff35-b62f-4b80-b9e0-66f52edcbd53 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:14.043890 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d1e8a-8ce0-4ed6-89c2-ed6ff07bf08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:14.044412 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d1e8a-8ce0-4ed6-89c2-ed6ff07bf08b None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:14.044690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d1e8a-8ce0-4ed6-89c2-ed6ff07bf08b None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:14.044992 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d1e8a-8ce0-4ed6-89c2-ed6ff07bf08b None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:14.045630 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d1e8a-8ce0-4ed6-89c2-ed6ff07bf08b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:14.045932 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d1e8a-8ce0-4ed6-89c2-ed6ff07bf08b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:14.047295 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d1e8a-8ce0-4ed6-89c2-ed6ff07bf08b None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:14.058733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 242/466] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:14.058733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f3124-d54c-471c-a931-938a97e33520 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:14.058733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f3124-d54c-471c-a931-938a97e33520 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:14.058733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f3124-d54c-471c-a931-938a97e33520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:14.066317 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 225/467] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Aug 19 01:11:13 2022] POST /identity/v3/users => generated 246 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:11:14.068067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e77c0-5555-4c20-81dc-f61e21a7d121 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:14.078671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-251f3124-d54c-471c-a931-938a97e33520 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:14.079929 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-251f3124-d54c-471c-a931-938a97e33520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:14.114789 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:14.138818 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:14.161931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 243/468] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:14.163026 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f3124-d54c-471c-a931-938a97e33520 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:14.214387 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e77c0-5555-4c20-81dc-f61e21a7d121 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:14.264871 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7453df4-80ad-42e1-9026-a57762fe1f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:14.265656 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7453df4-80ad-42e1-9026-a57762fe1f61 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:14.265937 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7453df4-80ad-42e1-9026-a57762fe1f61 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:14.266207 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7453df4-80ad-42e1-9026-a57762fe1f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:14.280801 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7453df4-80ad-42e1-9026-a57762fe1f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:14.282326 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7453df4-80ad-42e1-9026-a57762fe1f61 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:14.302710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-f7453df4-80ad-42e1-9026-a57762fe1f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:14.302710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:14.302710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:14.302710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:14.302710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:14.302710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:14.302710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:14.302710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:14.302710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:14.302710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:14.302710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:14.302710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:14.302710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:14.302710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:14.302710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:14.302710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:14.303627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:14.304487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:14.304487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:14.304487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:14.304487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 226/469] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:14.311102 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7453df4-80ad-42e1-9026-a57762fe1f61 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:14.322229 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f3124-d54c-471c-a931-938a97e33520 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:14.360069 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a71fdc-dc71-489f-a766-1f5b9e36e9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:14.360677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a71fdc-dc71-489f-a766-1f5b9e36e9e8 None admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:14.361558 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a71fdc-dc71-489f-a766-1f5b9e36e9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:14.361558 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a71fdc-dc71-489f-a766-1f5b9e36e9e8 None admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:14.362049 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a71fdc-dc71-489f-a766-1f5b9e36e9e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:14.363328 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a71fdc-dc71-489f-a766-1f5b9e36e9e8 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:14.430758 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:14.436664 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 244/470] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Aug 19 01:11:14 2022] POST /identity/v3/users => generated 248 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:11:14.440477 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7453df4-80ad-42e1-9026-a57762fe1f61 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:14.485413 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224e0a4-01f2-4802-a4e4-a7e4a4253496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:14.486337 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224e0a4-01f2-4802-a4e4-a7e4a4253496 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:14.486796 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224e0a4-01f2-4802-a4e4-a7e4a4253496 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:14.487274 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224e0a4-01f2-4802-a4e4-a7e4a4253496 None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:14.488395 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224e0a4-01f2-4802-a4e4-a7e4a4253496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:14.489423 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224e0a4-01f2-4802-a4e4-a7e4a4253496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:14.491024 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224e0a4-01f2-4802-a4e4-a7e4a4253496 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:14.506167 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 227/471] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:14.514038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a71fdc-dc71-489f-a766-1f5b9e36e9e8 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:14.530676 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224e0a4-01f2-4802-a4e4-a7e4a4253496 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:14.545340 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:14.660014 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a71fdc-dc71-489f-a766-1f5b9e36e9e8 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:14.673048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224e0a4-01f2-4802-a4e4-a7e4a4253496 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:14.708072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93339a1-d603-4318-a080-08985f2d7801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:14.708717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93339a1-d603-4318-a080-08985f2d7801 None admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:14.709050 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93339a1-d603-4318-a080-08985f2d7801 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:14.709329 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93339a1-d603-4318-a080-08985f2d7801 None admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:14.709949 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93339a1-d603-4318-a080-08985f2d7801 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:14.711999 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93339a1-d603-4318-a080-08985f2d7801 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:14.719799 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f27860-c266-43a9-960b-86356c59b861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:14.720447 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f27860-c266-43a9-960b-86356c59b861 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:14.721012 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f27860-c266-43a9-960b-86356c59b861 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:14.721295 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f27860-c266-43a9-960b-86356c59b861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:14.735901 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f27860-c266-43a9-960b-86356c59b861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:14.737430 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f27860-c266-43a9-960b-86356c59b861 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:14.753787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-18f27860-c266-43a9-960b-86356c59b861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:14.753787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:14.753787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:14.753787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:14.753787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:14.753787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:14.753787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:14.753787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:14.753787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:14.753787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:14.753787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:14.753787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:14.753787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:14.753787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:14.753787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:14.753787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:14.754730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:14.755585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:14.755585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:14.755585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:14.756295 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 228/472] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:11:14.761800 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f27860-c266-43a9-960b-86356c59b861 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:14.775061 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:14.829032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 245/473] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Aug 19 01:11:14 2022] POST /identity/v3/users => generated 248 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:11:14.886691 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f27860-c266-43a9-960b-86356c59b861 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:14.929721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c322a9-023d-4b1e-8fcf-c2f39906e1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:14.930663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c322a9-023d-4b1e-8fcf-c2f39906e1b6 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:14.931115 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c322a9-023d-4b1e-8fcf-c2f39906e1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:14.931556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c322a9-023d-4b1e-8fcf-c2f39906e1b6 None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:14.932398 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c322a9-023d-4b1e-8fcf-c2f39906e1b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:14.932931 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c322a9-023d-4b1e-8fcf-c2f39906e1b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:14.934733 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c322a9-023d-4b1e-8fcf-c2f39906e1b6 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:14.954290 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 229/474] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:14.955972 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93339a1-d603-4318-a080-08985f2d7801 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:15.049715 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:15.072681 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93339a1-d603-4318-a080-08985f2d7801 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:15.118467 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e184bb8-f645-4a02-b7f7-b92456908edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:15.119133 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e184bb8-f645-4a02-b7f7-b92456908edf None admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:15.119412 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e184bb8-f645-4a02-b7f7-b92456908edf None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:15.119680 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e184bb8-f645-4a02-b7f7-b92456908edf None admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:15.120955 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e184bb8-f645-4a02-b7f7-b92456908edf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:15.122399 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e184bb8-f645-4a02-b7f7-b92456908edf None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:15.221149 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 246/475] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Aug 19 01:11:14 2022] POST /identity/v3/users => generated 249 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:11:16.462167 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293bb67-91c2-4fe6-8316-34a36afb2c15 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:16.462719 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293bb67-91c2-4fe6-8316-34a36afb2c15 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:16.462719 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293bb67-91c2-4fe6-8316-34a36afb2c15 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:16.465170 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 230/476] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:16.470528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8af56-ad8e-4b9a-abab-8f63b27448c3 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:16.470941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8af56-ad8e-4b9a-abab-8f63b27448c3 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:16.471132 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8af56-ad8e-4b9a-abab-8f63b27448c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:16.489143 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-bdb8af56-ad8e-4b9a-abab-8f63b27448c3 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:16.490316 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-bdb8af56-ad8e-4b9a-abab-8f63b27448c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:16.567035 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 247/477] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:16.824623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009f595-0f0b-4d87-85a3-8393e0bee54d None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:16.824810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009f595-0f0b-4d87-85a3-8393e0bee54d None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:16.825127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009f595-0f0b-4d87-85a3-8393e0bee54d None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:16.826725 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 231/478] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:16.832108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fcb1d-1d2f-4c4b-88ec-621cdf2cab79 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:16.832397 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fcb1d-1d2f-4c4b-88ec-621cdf2cab79 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:16.832672 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fcb1d-1d2f-4c4b-88ec-621cdf2cab79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:16.851429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-482fcb1d-1d2f-4c4b-88ec-621cdf2cab79 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:16.852616 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-482fcb1d-1d2f-4c4b-88ec-621cdf2cab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:16.904139 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009f595-0f0b-4d87-85a3-8393e0bee54d None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:16.925327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:16.930876 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 248/479] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:16.980597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:17.018010 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009f595-0f0b-4d87-85a3-8393e0bee54d None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:17.056744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6c008-8c52-4402-8a6e-9916fe5677b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:17.057936 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6c008-8c52-4402-8a6e-9916fe5677b6 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:17.058287 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6c008-8c52-4402-8a6e-9916fe5677b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:17.058646 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6c008-8c52-4402-8a6e-9916fe5677b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:17.071265 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6c008-8c52-4402-8a6e-9916fe5677b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:17.077536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-06d6c008-8c52-4402-8a6e-9916fe5677b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:17.077536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:17.077536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:17.077536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:17.077536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:17.077536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:17.077536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:17.077536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:17.077536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:17.077536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:17.077536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:17.077536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:17.077536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:17.077536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:17.077536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:17.077536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:17.078437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:17.078437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:17.078437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:17.078437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:17.078437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:17.078437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:17.078437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:17.078437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:17.078437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:17.078437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:17.078437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:17.078437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:17.078437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:17.078437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:17.078437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:17.078437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:17.079464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:17.079464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:17.079464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:17.079464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:17.079464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:17.079464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:17.079464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:17.079464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:17.079464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:17.079464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:17.079464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:17.079464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:17.079464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 232/480] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:11:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:17.085916 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fcb1d-1d2f-4c4b-88ec-621cdf2cab79 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:17.201284 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fcb1d-1d2f-4c4b-88ec-621cdf2cab79 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:17.229811 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33d1ee-94c7-4a9f-b3fb-365e39bee5a8 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:17.230284 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33d1ee-94c7-4a9f-b3fb-365e39bee5a8 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:17.230574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33d1ee-94c7-4a9f-b3fb-365e39bee5a8 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:17.232106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 233/481] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:17.237194 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd1823-04b2-442b-8e6d-f053b1d20894 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:17.237463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd1823-04b2-442b-8e6d-f053b1d20894 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:17.237738 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd1823-04b2-442b-8e6d-f053b1d20894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:17.238208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95390b-d7b2-4a33-9809-619960f13ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:17.238814 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95390b-d7b2-4a33-9809-619960f13ee6 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:17.239090 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95390b-d7b2-4a33-9809-619960f13ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:17.239360 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95390b-d7b2-4a33-9809-619960f13ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:17.240018 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95390b-d7b2-4a33-9809-619960f13ee6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:17.240314 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95390b-d7b2-4a33-9809-619960f13ee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:17.241721 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95390b-d7b2-4a33-9809-619960f13ee6 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:17.250007 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 249/482] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Aug 19 01:11:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:17.257588 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95390b-d7b2-4a33-9809-619960f13ee6 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:17.265288 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-00cd1823-04b2-442b-8e6d-f053b1d20894 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:17.266662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-00cd1823-04b2-442b-8e6d-f053b1d20894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:17.316448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:17.342308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 234/483] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:17.343355 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd1823-04b2-442b-8e6d-f053b1d20894 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:17.374995 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95390b-d7b2-4a33-9809-619960f13ee6 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:17.418497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d565c-80fa-4b6c-996f-bf976e021ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:17.425090 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d565c-80fa-4b6c-996f-bf976e021ddc None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:17.425686 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d565c-80fa-4b6c-996f-bf976e021ddc None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:17.426185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d565c-80fa-4b6c-996f-bf976e021ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:17.434386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:17.440319 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d565c-80fa-4b6c-996f-bf976e021ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:17.441866 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d565c-80fa-4b6c-996f-bf976e021ddc None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:17.458396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-ab7d565c-80fa-4b6c-996f-bf976e021ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:17.458396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:17.458396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:17.458396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:17.458396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:17.458396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:17.458396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:17.458396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:17.458396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:17.458396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:17.458396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:17.458396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:17.458396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:17.458396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:17.458396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:17.458396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:17.459324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:17.460147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:17.460147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:17.460147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:17.465032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 250/484] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:17.466532 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d565c-80fa-4b6c-996f-bf976e021ddc None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:17.492796 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd1823-04b2-442b-8e6d-f053b1d20894 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:17.538069 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb5fe7-c9a2-44f1-a720-1d4f893e71e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:17.538069 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb5fe7-c9a2-44f1-a720-1d4f893e71e0 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:17.538328 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb5fe7-c9a2-44f1-a720-1d4f893e71e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:17.538571 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb5fe7-c9a2-44f1-a720-1d4f893e71e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:17.553244 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb5fe7-c9a2-44f1-a720-1d4f893e71e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:17.558037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-07fb5fe7-c9a2-44f1-a720-1d4f893e71e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:17.558037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:17.558037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:17.558037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:17.558037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:17.558037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:17.558037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:17.558037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:17.558037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:17.558037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:17.558037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:17.558037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:17.558037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:17.558037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:17.558037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:17.558037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:17.559036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:17.559036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:17.559036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:17.559036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:17.559036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:17.559036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:17.559036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:17.559036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:17.559036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:17.559036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:17.559036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:17.559036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:17.559036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:17.559036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:17.559036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:17.559036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:17.560071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:17.560071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:17.560071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:17.560071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:17.560071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:17.560071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:17.560071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:17.560071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:17.560071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:17.560071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:17.560071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:17.560071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:17.560071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 235/485] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:11:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:17.560955 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f308f-9939-49a5-a26c-5c591e059130 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:17.561036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f308f-9939-49a5-a26c-5c591e059130 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:17.561312 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f308f-9939-49a5-a26c-5c591e059130 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:17.562643 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 236/486] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:17.564894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f308f-9939-49a5-a26c-5c591e059130 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:17.586883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d565c-80fa-4b6c-996f-bf976e021ddc None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:17.596221 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:17.621839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661d0e0-38bc-4dff-aee4-3ec83a85cf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:17.622448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661d0e0-38bc-4dff-aee4-3ec83a85cf86 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:17.622722 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661d0e0-38bc-4dff-aee4-3ec83a85cf86 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:17.622990 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661d0e0-38bc-4dff-aee4-3ec83a85cf86 None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:17.623619 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661d0e0-38bc-4dff-aee4-3ec83a85cf86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:17.623917 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661d0e0-38bc-4dff-aee4-3ec83a85cf86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:17.625331 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661d0e0-38bc-4dff-aee4-3ec83a85cf86 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:17.644009 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 251/487] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:17.644009 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db86609-739c-4836-86ef-0a553f91dbf9 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:17.644009 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db86609-739c-4836-86ef-0a553f91dbf9 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:17.644009 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db86609-739c-4836-86ef-0a553f91dbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:17.660884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-4db86609-739c-4836-86ef-0a553f91dbf9 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:17.661831 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-4db86609-739c-4836-86ef-0a553f91dbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:17.685523 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f308f-9939-49a5-a26c-5c591e059130 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:17.705279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:17.723383 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9a1cf-b13e-48c4-a366-a5934acc03d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:17.723977 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9a1cf-b13e-48c4-a366-a5934acc03d4 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:17.724250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9a1cf-b13e-48c4-a366-a5934acc03d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:17.724512 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9a1cf-b13e-48c4-a366-a5934acc03d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:17.725196 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9a1cf-b13e-48c4-a366-a5934acc03d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:17.725494 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9a1cf-b13e-48c4-a366-a5934acc03d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:17.726881 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9a1cf-b13e-48c4-a366-a5934acc03d4 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:17.729333 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 252/488] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:17.730721 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db86609-739c-4836-86ef-0a553f91dbf9 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:17.736760 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 237/489] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Aug 19 01:11:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:17.742000 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9a1cf-b13e-48c4-a366-a5934acc03d4 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:17.844132 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:17.848918 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db86609-739c-4836-86ef-0a553f91dbf9 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:17.856421 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9a1cf-b13e-48c4-a366-a5934acc03d4 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:17.890448 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befb240-fc77-458f-a14d-cd34a1edd700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:17.890865 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f4a82-124a-4a5a-a61d-3f76e22cedb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:17.891083 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befb240-fc77-458f-a14d-cd34a1edd700 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:17.891359 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befb240-fc77-458f-a14d-cd34a1edd700 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:17.891520 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f4a82-124a-4a5a-a61d-3f76e22cedb9 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:17.891622 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befb240-fc77-458f-a14d-cd34a1edd700 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:17.891789 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f4a82-124a-4a5a-a61d-3f76e22cedb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:17.892017 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f4a82-124a-4a5a-a61d-3f76e22cedb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:17.899267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befb240-fc77-458f-a14d-cd34a1edd700 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:17.900785 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befb240-fc77-458f-a14d-cd34a1edd700 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:17.903028 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f4a82-124a-4a5a-a61d-3f76e22cedb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:17.908184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-2e7f4a82-124a-4a5a-a61d-3f76e22cedb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:17.908184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:17.908184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:17.908184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:17.908184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:17.908184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:17.908184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:17.908184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:17.908184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:17.908184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:17.908184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:17.908184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:17.908184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:17.908184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:17.908184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:17.908184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:17.913894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:17.913894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:17.913894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:17.913894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:17.913894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:17.913894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:17.913894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:17.913894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:17.913894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:17.913894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:17.913894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:17.913894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:17.913894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:17.913894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:17.913894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:17.913894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:17.914708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:17.914708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:17.914708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:17.914708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:17.914708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:17.914708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:17.914708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:17.914708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:17.914708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:17.914708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:17.914708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:17.914708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:17.914708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 238/490] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:11:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:17.914708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f4a82-124a-4a5a-a61d-3f76e22cedb9 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:17.915539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-9befb240-fc77-458f-a14d-cd34a1edd700 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 01:11:17.915539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:17.915539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:17.915539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:17.915539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:17.915539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:17.915539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:17.915539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:17.915539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:17.915539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:17.915539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:17.915539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:17.915539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:11:17.915539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:11:17.915539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:11:17.915539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:17.916497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:17.918426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:17.918426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:17.918426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:11:17.918426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:11:17.918426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:11:17.918426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:11:17.918426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:11:17.918426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:11:17.918426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 01:11:17.918426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:17.918426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 253/491] 10.222.0.82 () {56 vars in 1093 bytes} [Fri Aug 19 01:11:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:17.918426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befb240-fc77-458f-a14d-cd34a1edd700 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:17.971721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:18.034045 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befb240-fc77-458f-a14d-cd34a1edd700 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:18.038563 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f4a82-124a-4a5a-a61d-3f76e22cedb9 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:18.071100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e0322-0521-4862-9141-44f4743bdc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:18.071703 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e0322-0521-4862-9141-44f4743bdc80 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:18.071976 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e0322-0521-4862-9141-44f4743bdc80 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:18.072244 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e0322-0521-4862-9141-44f4743bdc80 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:18.072931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e0322-0521-4862-9141-44f4743bdc80 None admin] RBAC: Adding query filter params (name=service) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:18.073256 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e0322-0521-4862-9141-44f4743bdc80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:18.074636 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95336fd4-820c-4cf4-88e0-006540f9e319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:18.074750 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e0322-0521-4862-9141-44f4743bdc80 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:18.075257 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95336fd4-820c-4cf4-88e0-006540f9e319 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:18.075536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95336fd4-820c-4cf4-88e0-006540f9e319 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:18.075815 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95336fd4-820c-4cf4-88e0-006540f9e319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:18.082621 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 254/492] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Aug 19 01:11:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:18.083469 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e0322-0521-4862-9141-44f4743bdc80 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:18.086809 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95336fd4-820c-4cf4-88e0-006540f9e319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:18.088540 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95336fd4-820c-4cf4-88e0-006540f9e319 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:18.102792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-95336fd4-820c-4cf4-88e0-006540f9e319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:18.102792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:18.102792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:18.102792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:18.102792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:18.102792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:18.102792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:18.102792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:18.102792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:18.102792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:18.102792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:18.102792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:18.102792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:18.102792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:18.102792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:18.102792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:18.103876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:18.105333 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:18.105333 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:18.105333 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:18.105333 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 239/493] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:18.105940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95336fd4-820c-4cf4-88e0-006540f9e319 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:18.106401 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:18.187279 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e0322-0521-4862-9141-44f4743bdc80 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:18.202503 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:18.211181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95336fd4-820c-4cf4-88e0-006540f9e319 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:18.220595 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2d701-27ce-4daf-ad41-4d02368fd8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:18.221230 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2d701-27ce-4daf-ad41-4d02368fd8b9 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:18.221514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2d701-27ce-4daf-ad41-4d02368fd8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:18.221788 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2d701-27ce-4daf-ad41-4d02368fd8b9 None admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:18.222508 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2d701-27ce-4daf-ad41-4d02368fd8b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:18.222815 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2d701-27ce-4daf-ad41-4d02368fd8b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:18.224249 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2d701-27ce-4daf-ad41-4d02368fd8b9 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:18.245003 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879da98-2243-480e-8312-cc249526186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:18.245620 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879da98-2243-480e-8312-cc249526186e None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:18.245949 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879da98-2243-480e-8312-cc249526186e None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:18.246219 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879da98-2243-480e-8312-cc249526186e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:18.256602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879da98-2243-480e-8312-cc249526186e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:18.261285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-4879da98-2243-480e-8312-cc249526186e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:18.261285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:18.261285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:18.261285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:18.261285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:18.261285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:18.261285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:18.261285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:18.261285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:18.261285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:18.261285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:18.261285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:18.261285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:18.261285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:18.261285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:18.261285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:18.262127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:18.262127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:18.262127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:18.262127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:18.262127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:18.262127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:18.262127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:18.262127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:18.262127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:18.262127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:18.262127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:18.262127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:18.262127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:18.262127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:18.262127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:18.262127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:18.262915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:18.262915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:18.262915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:18.262915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:18.262915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:18.262915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:18.262915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:18.262915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:18.262915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:18.262915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:18.262915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:18.262915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:18.263508 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 255/494] 10.222.0.82 () {56 vars in 1133 bytes} [Fri Aug 19 01:11:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:18.263508 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2d701-27ce-4daf-ad41-4d02368fd8b9 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:18.263627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 240/495] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:11:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:18.263627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879da98-2243-480e-8312-cc249526186e None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:18.343200 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:18.364214 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2d701-27ce-4daf-ad41-4d02368fd8b9 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:18.365387 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879da98-2243-480e-8312-cc249526186e None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:18.397761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2515f-b2cd-41f6-9e04-c5acff45e3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:18.398116 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890793b-b0aa-4fed-a06e-3d2a76e6ed8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:18.398383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2515f-b2cd-41f6-9e04-c5acff45e3c2 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:18.398658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2515f-b2cd-41f6-9e04-c5acff45e3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:18.398749 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890793b-b0aa-4fed-a06e-3d2a76e6ed8d None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:18.398931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2515f-b2cd-41f6-9e04-c5acff45e3c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:18.399091 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890793b-b0aa-4fed-a06e-3d2a76e6ed8d None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:18.399281 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890793b-b0aa-4fed-a06e-3d2a76e6ed8d None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:18.399860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890793b-b0aa-4fed-a06e-3d2a76e6ed8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:18.400163 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890793b-b0aa-4fed-a06e-3d2a76e6ed8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:18.402348 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890793b-b0aa-4fed-a06e-3d2a76e6ed8d None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:18.409205 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2515f-b2cd-41f6-9e04-c5acff45e3c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:18.410635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2515f-b2cd-41f6-9e04-c5acff45e3c2 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:18.413848 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 241/496] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:18.414641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890793b-b0aa-4fed-a06e-3d2a76e6ed8d None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:18.426582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-bed2515f-b2cd-41f6-9e04-c5acff45e3c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:18.426582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:18.426582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:18.426582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:18.426582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:18.426582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:18.426582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:18.426582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:18.426582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:18.426582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:18.426582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:18.426582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:18.426582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:18.426582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:18.426582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:18.426582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:18.427662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:18.433409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:18.433409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:18.433409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:18.433409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 256/497] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:18.433409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2515f-b2cd-41f6-9e04-c5acff45e3c2 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:18.434218 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:18.516419 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890793b-b0aa-4fed-a06e-3d2a76e6ed8d None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:18.532535 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2515f-b2cd-41f6-9e04-c5acff45e3c2 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:18.550677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ca16a-89c1-496c-9f0d-9c8633846145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:18.551280 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ca16a-89c1-496c-9f0d-9c8633846145 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:18.551554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ca16a-89c1-496c-9f0d-9c8633846145 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:18.551822 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ca16a-89c1-496c-9f0d-9c8633846145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:18.565844 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:18.571434 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5b06b-a608-4f5d-b6e2-ea5cc6825f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:18.572032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5b06b-a608-4f5d-b6e2-ea5cc6825f03 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:18.572309 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5b06b-a608-4f5d-b6e2-ea5cc6825f03 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:18.572576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5b06b-a608-4f5d-b6e2-ea5cc6825f03 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:18.573588 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5b06b-a608-4f5d-b6e2-ea5cc6825f03 None admin] RBAC: Adding query filter params (name=service) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:18.574102 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5b06b-a608-4f5d-b6e2-ea5cc6825f03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:18.575482 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5b06b-a608-4f5d-b6e2-ea5cc6825f03 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:18.584194 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 257/498] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Aug 19 01:11:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:18.585084 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5b06b-a608-4f5d-b6e2-ea5cc6825f03 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:18.622788 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ca16a-89c1-496c-9f0d-9c8633846145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:18.624202 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ca16a-89c1-496c-9f0d-9c8633846145 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:18.638844 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:18.684543 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5b06b-a608-4f5d-b6e2-ea5cc6825f03 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:18.719950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670e6b7-adc4-4820-8c51-f2c28300534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:18.720575 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670e6b7-adc4-4820-8c51-f2c28300534c None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:18.720873 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670e6b7-adc4-4820-8c51-f2c28300534c None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:18.721147 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670e6b7-adc4-4820-8c51-f2c28300534c None admin] PATH_INFO: `/v3/users/glance` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:18.728320 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670e6b7-adc4-4820-8c51-f2c28300534c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:18.728687 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 242/499] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:11:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:11:18.729654 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ca16a-89c1-496c-9f0d-9c8633846145 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:18.730009 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670e6b7-adc4-4820-8c51-f2c28300534c None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:18.741857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-5670e6b7-adc4-4820-8c51-f2c28300534c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 01:11:18.741857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:18.741857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:18.741857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:18.741857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:18.741857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:18.741857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:18.741857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:18.741857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:18.741857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:18.741857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:18.741857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:18.741857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:11:18.741857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:11:18.741857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:11:18.741857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:18.743066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:18.744128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:18.744128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:18.744128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:11:18.744128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:11:18.744128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:11:18.744128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:11:18.744128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:11:18.744128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:11:18.744128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 01:11:18.744128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:18.744128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 258/500] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:11:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:18.744128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670e6b7-adc4-4820-8c51-f2c28300534c None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:18.798201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:18.834866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ca16a-89c1-496c-9f0d-9c8633846145 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:18.846797 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670e6b7-adc4-4820-8c51-f2c28300534c None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:18.848573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:18.868887 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53254bf-7238-451b-954d-1aa1fa27bf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:18.869485 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53254bf-7238-451b-954d-1aa1fa27bf5e None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:18.869759 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53254bf-7238-451b-954d-1aa1fa27bf5e None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:18.870066 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53254bf-7238-451b-954d-1aa1fa27bf5e None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:18.870699 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53254bf-7238-451b-954d-1aa1fa27bf5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:18.871007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53254bf-7238-451b-954d-1aa1fa27bf5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:18.874004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53254bf-7238-451b-954d-1aa1fa27bf5e None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:18.879885 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17b8f5-746b-4ea8-82a6-efdf5f20e5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:18.880567 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17b8f5-746b-4ea8-82a6-efdf5f20e5ac None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:18.880864 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17b8f5-746b-4ea8-82a6-efdf5f20e5ac None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:18.881149 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17b8f5-746b-4ea8-82a6-efdf5f20e5ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:18.884563 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 243/501] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:18.885397 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53254bf-7238-451b-954d-1aa1fa27bf5e None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:18.892816 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17b8f5-746b-4ea8-82a6-efdf5f20e5ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:18.894306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17b8f5-746b-4ea8-82a6-efdf5f20e5ac None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:18.909767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-cc17b8f5-746b-4ea8-82a6-efdf5f20e5ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:18.909767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:18.909767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:18.909767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:18.909767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:18.909767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:18.909767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:18.909767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:18.909767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:18.909767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:18.909767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:18.909767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:18.909767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:18.909767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:18.909767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:18.909767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:18.910847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:18.911697 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:18.911697 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:18.911697 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:18.911697 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 259/502] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:18.911917 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17b8f5-746b-4ea8-82a6-efdf5f20e5ac None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:18.990327 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53254bf-7238-451b-954d-1aa1fa27bf5e None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:19.011680 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17b8f5-746b-4ea8-82a6-efdf5f20e5ac None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:19.013948 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:19.024003 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5da7f-4d48-4aa4-b161-d98360b5b720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:19.028753 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5da7f-4d48-4aa4-b161-d98360b5b720 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:19.028753 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5da7f-4d48-4aa4-b161-d98360b5b720 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:19.028753 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5da7f-4d48-4aa4-b161-d98360b5b720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:19.035865 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5da7f-4d48-4aa4-b161-d98360b5b720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:19.037443 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5da7f-4d48-4aa4-b161-d98360b5b720 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:19.044462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed760113-2ff7-4276-8c5e-da2c75ca1e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:19.045082 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed760113-2ff7-4276-8c5e-da2c75ca1e08 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:19.045378 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed760113-2ff7-4276-8c5e-da2c75ca1e08 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:19.045629 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed760113-2ff7-4276-8c5e-da2c75ca1e08 None admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:19.046347 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed760113-2ff7-4276-8c5e-da2c75ca1e08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:19.046648 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed760113-2ff7-4276-8c5e-da2c75ca1e08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:19.048395 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed760113-2ff7-4276-8c5e-da2c75ca1e08 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:19.051554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-e0e5da7f-4d48-4aa4-b161-d98360b5b720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:19.051554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:19.051554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:19.051554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:19.051554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:19.051554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:19.051554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:19.051554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:19.051554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:19.051554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:19.051554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:19.051554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:19.051554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:19.051554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:19.051554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:19.051554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:19.052429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:19.053500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:19.053500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:19.053500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:19.053500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 244/503] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:19.053500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5da7f-4d48-4aa4-b161-d98360b5b720 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:19.066455 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 260/504] 10.222.0.82 () {56 vars in 1137 bytes} [Fri Aug 19 01:11:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:19.067302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed760113-2ff7-4276-8c5e-da2c75ca1e08 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:19.086635 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:19.164263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5da7f-4d48-4aa4-b161-d98360b5b720 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:19.170988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed760113-2ff7-4276-8c5e-da2c75ca1e08 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:19.199096 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a1cc0-1fe6-4341-971c-5185e397329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:19.199723 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a1cc0-1fe6-4341-971c-5185e397329d None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:19.200003 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a1cc0-1fe6-4341-971c-5185e397329d None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:19.200277 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a1cc0-1fe6-4341-971c-5185e397329d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:19.204259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f1499-9f42-4d6d-a1c4-0223c88a619c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:19.204886 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f1499-9f42-4d6d-a1c4-0223c88a619c None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:19.205168 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f1499-9f42-4d6d-a1c4-0223c88a619c None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:19.205440 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f1499-9f42-4d6d-a1c4-0223c88a619c None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:19.206069 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f1499-9f42-4d6d-a1c4-0223c88a619c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:19.206372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f1499-9f42-4d6d-a1c4-0223c88a619c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:19.207339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a1cc0-1fe6-4341-971c-5185e397329d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:19.207735 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f1499-9f42-4d6d-a1c4-0223c88a619c None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:19.208785 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a1cc0-1fe6-4341-971c-5185e397329d None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:19.219265 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 261/505] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:19.220158 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f1499-9f42-4d6d-a1c4-0223c88a619c None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:19.222088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-d02a1cc0-1fe6-4341-971c-5185e397329d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 01:11:19.222088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:19.222088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:19.222088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:19.222088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:19.222088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:19.222088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:19.222088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:19.222088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:19.222088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:19.222088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:19.222088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:19.222088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:11:19.222088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:11:19.222088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:11:19.222088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:19.222960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:19.223863 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:19.223863 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:19.223863 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:11:19.223863 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:11:19.223863 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:11:19.223863 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:11:19.223863 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:11:19.223863 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:11:19.223863 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 01:11:19.223863 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:19.223863 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 245/506] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:11:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:19.224428 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a1cc0-1fe6-4341-971c-5185e397329d None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:19.247188 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:19.309735 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:19.323620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f1499-9f42-4d6d-a1c4-0223c88a619c None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:19.325556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a1cc0-1fe6-4341-971c-5185e397329d None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:19.359125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7ec0d-94f5-4d03-9173-7951cf359df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:19.359732 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7ec0d-94f5-4d03-9173-7951cf359df1 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:19.360007 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7ec0d-94f5-4d03-9173-7951cf359df1 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:19.360276 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7ec0d-94f5-4d03-9173-7951cf359df1 None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:19.360807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27025d-93e6-4cf8-a996-79aaadd27f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:19.360963 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7ec0d-94f5-4d03-9173-7951cf359df1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:19.361238 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7ec0d-94f5-4d03-9173-7951cf359df1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:19.361419 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27025d-93e6-4cf8-a996-79aaadd27f92 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:19.361695 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27025d-93e6-4cf8-a996-79aaadd27f92 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:19.361959 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27025d-93e6-4cf8-a996-79aaadd27f92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:19.362600 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7ec0d-94f5-4d03-9173-7951cf359df1 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:19.374433 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 262/507] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:19.375237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7ec0d-94f5-4d03-9173-7951cf359df1 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:19.434045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27025d-93e6-4cf8-a996-79aaadd27f92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:19.435437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27025d-93e6-4cf8-a996-79aaadd27f92 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:19.458088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:19.476376 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7ec0d-94f5-4d03-9173-7951cf359df1 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:19.510319 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96b172-bbe2-4fb1-9b20-b857d6403423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:19.511649 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96b172-bbe2-4fb1-9b20-b857d6403423 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:19.511978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96b172-bbe2-4fb1-9b20-b857d6403423 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:19.512251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96b172-bbe2-4fb1-9b20-b857d6403423 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:19.519275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96b172-bbe2-4fb1-9b20-b857d6403423 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:19.520743 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96b172-bbe2-4fb1-9b20-b857d6403423 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:19.523118 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:19.533643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-5c96b172-bbe2-4fb1-9b20-b857d6403423 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 01:11:19.533643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:19.533643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:19.533643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:19.533643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:19.533643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:19.533643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:19.533643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:19.533643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:19.533643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:19.533643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:19.533643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:19.533643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:11:19.533643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:11:19.533643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:11:19.533643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:19.538684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:19.539569 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:19.539569 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:19.539569 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:11:19.539569 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:11:19.539569 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:11:19.539569 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:11:19.539569 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:11:19.539569 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:11:19.539569 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 01:11:19.539569 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:19.539569 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 263/508] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:11:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:19.539569 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96b172-bbe2-4fb1-9b20-b857d6403423 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:19.544147 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 246/509] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:11:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:11:19.545286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27025d-93e6-4cf8-a996-79aaadd27f92 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:19.638551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96b172-bbe2-4fb1-9b20-b857d6403423 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:19.645553 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27025d-93e6-4cf8-a996-79aaadd27f92 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:19.671984 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c38ec6-7f93-4d76-92e8-08fa817b2fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:19.672584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c38ec6-7f93-4d76-92e8-08fa817b2fb4 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:19.672872 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c38ec6-7f93-4d76-92e8-08fa817b2fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:19.673163 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c38ec6-7f93-4d76-92e8-08fa817b2fb4 None admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:19.673884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c38ec6-7f93-4d76-92e8-08fa817b2fb4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:19.674188 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c38ec6-7f93-4d76-92e8-08fa817b2fb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:19.675634 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c38ec6-7f93-4d76-92e8-08fa817b2fb4 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:19.680219 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacfaf6-c471-4862-a6e7-80559c7507be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:19.680832 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacfaf6-c471-4862-a6e7-80559c7507be None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:19.681134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacfaf6-c471-4862-a6e7-80559c7507be None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:19.681401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacfaf6-c471-4862-a6e7-80559c7507be None admin] PATH_INFO: `/v3/projects/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:19.688698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacfaf6-c471-4862-a6e7-80559c7507be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:19.689583 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:19.690107 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacfaf6-c471-4862-a6e7-80559c7507be None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:19.693101 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 264/510] 10.222.0.82 () {56 vars in 1137 bytes} [Fri Aug 19 01:11:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:19.693888 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c38ec6-7f93-4d76-92e8-08fa817b2fb4 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:19.702297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-7eacfaf6-c471-4862-a6e7-80559c7507be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:19.702297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:19.702297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:19.702297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:19.702297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:19.702297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:19.702297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:19.702297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:19.702297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:19.702297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:19.702297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:19.702297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:19.702297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:11:19.702297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:11:19.702297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:19.703162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:19.704011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:11:19.704011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:11:19.704011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:11:19.704011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:11:19.704011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:11:19.704011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:11:19.704011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:19.704011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:19.704011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 247/511] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:19.705247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacfaf6-c471-4862-a6e7-80559c7507be None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:19.752601 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:19.794514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c38ec6-7f93-4d76-92e8-08fa817b2fb4 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:19.808156 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacfaf6-c471-4862-a6e7-80559c7507be None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:19.829463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438196e-cf6e-4a17-98a3-7a8fdd0f7b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:19.830061 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438196e-cf6e-4a17-98a3-7a8fdd0f7b93 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:19.830337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438196e-cf6e-4a17-98a3-7a8fdd0f7b93 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:19.830606 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438196e-cf6e-4a17-98a3-7a8fdd0f7b93 None admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:19.831355 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438196e-cf6e-4a17-98a3-7a8fdd0f7b93 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:19.831664 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438196e-cf6e-4a17-98a3-7a8fdd0f7b93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:19.833209 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438196e-cf6e-4a17-98a3-7a8fdd0f7b93 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:19.842774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dfcd2-9c8d-480f-9580-724fc35b691f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:19.843406 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dfcd2-9c8d-480f-9580-724fc35b691f None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:19.843682 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dfcd2-9c8d-480f-9580-724fc35b691f None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:19.843951 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dfcd2-9c8d-480f-9580-724fc35b691f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:19.850825 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 265/512] 10.222.0.82 () {56 vars in 1139 bytes} [Fri Aug 19 01:11:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:19.851638 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438196e-cf6e-4a17-98a3-7a8fdd0f7b93 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:19.854473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dfcd2-9c8d-480f-9580-724fc35b691f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:19.855962 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dfcd2-9c8d-480f-9580-724fc35b691f None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:19.871135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-580dfcd2-9c8d-480f-9580-724fc35b691f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:19.871135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:19.871135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:19.871135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:19.871135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:19.871135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:19.871135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:19.871135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:19.871135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:19.871135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:19.871135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:19.871135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:19.871135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:19.871135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:19.871135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:19.871135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:19.872019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:19.873181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:19.873181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:19.873181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:19.873181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 248/513] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:19.873419 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dfcd2-9c8d-480f-9580-724fc35b691f None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:19.913983 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:19.955713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438196e-cf6e-4a17-98a3-7a8fdd0f7b93 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:19.970736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:19.976315 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dfcd2-9c8d-480f-9580-724fc35b691f None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:19.988727 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb92aed-3807-48c8-a2f9-5e4ec3869b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:19.989444 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb92aed-3807-48c8-a2f9-5e4ec3869b61 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:19.989722 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb92aed-3807-48c8-a2f9-5e4ec3869b61 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:19.989996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb92aed-3807-48c8-a2f9-5e4ec3869b61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:20.011730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c851b-4b71-46fa-9103-150ed28c49d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:20.012384 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c851b-4b71-46fa-9103-150ed28c49d9 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:20.012670 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c851b-4b71-46fa-9103-150ed28c49d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:20.012974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c851b-4b71-46fa-9103-150ed28c49d9 None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:20.013659 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c851b-4b71-46fa-9103-150ed28c49d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:20.013960 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c851b-4b71-46fa-9103-150ed28c49d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:20.015408 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c851b-4b71-46fa-9103-150ed28c49d9 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:20.032841 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 249/514] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:11:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:20.033669 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c851b-4b71-46fa-9103-150ed28c49d9 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:20.058938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb92aed-3807-48c8-a2f9-5e4ec3869b61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:20.060401 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb92aed-3807-48c8-a2f9-5e4ec3869b61 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:20.116873 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:20.133809 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c851b-4b71-46fa-9103-150ed28c49d9 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:20.158974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 266/515] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:11:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:11:20.159811 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb92aed-3807-48c8-a2f9-5e4ec3869b61 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:20.169792 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efad0cf-00ed-4990-91cb-a256099b2969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:20.170400 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efad0cf-00ed-4990-91cb-a256099b2969 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:20.170686 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efad0cf-00ed-4990-91cb-a256099b2969 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:20.170965 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efad0cf-00ed-4990-91cb-a256099b2969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:20.196560 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:20.239831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efad0cf-00ed-4990-91cb-a256099b2969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:20.241237 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efad0cf-00ed-4990-91cb-a256099b2969 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:20.256919 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb92aed-3807-48c8-a2f9-5e4ec3869b61 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:20.291103 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084645bf-af83-4c3a-8d68-1e57a885105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:20.291705 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084645bf-af83-4c3a-8d68-1e57a885105d None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:20.292069 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084645bf-af83-4c3a-8d68-1e57a885105d None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:20.292345 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084645bf-af83-4c3a-8d68-1e57a885105d None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:20.293014 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084645bf-af83-4c3a-8d68-1e57a885105d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:20.293318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084645bf-af83-4c3a-8d68-1e57a885105d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:20.294690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084645bf-af83-4c3a-8d68-1e57a885105d None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:20.305572 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 267/516] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:20.306423 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084645bf-af83-4c3a-8d68-1e57a885105d None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:20.327495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:20.342953 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 250/517] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:11:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:11:20.344011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efad0cf-00ed-4990-91cb-a256099b2969 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:20.400323 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:20.408684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084645bf-af83-4c3a-8d68-1e57a885105d None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:20.442097 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4716b3-b06a-4c11-94e8-17e3d32d6bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:20.442693 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4716b3-b06a-4c11-94e8-17e3d32d6bff None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:20.442970 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4716b3-b06a-4c11-94e8-17e3d32d6bff None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:20.443240 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4716b3-b06a-4c11-94e8-17e3d32d6bff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:20.443950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4716b3-b06a-4c11-94e8-17e3d32d6bff None admin] RBAC: Adding query filter params (role.id=c1ad293fe0c443e98339ca975dc18549, scope.project.id=b38e380f92824682a8286e59af2fc23c, user.id=ea9fe590dcf441b09f4fe18bf3d8a7ce) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:20.444255 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4716b3-b06a-4c11-94e8-17e3d32d6bff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:20.445041 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efad0cf-00ed-4990-91cb-a256099b2969 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:20.445769 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4716b3-b06a-4c11-94e8-17e3d32d6bff None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:20.451877 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 268/518] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:11:20 2022] GET /identity/v3/role_assignments?user.id=ea9fe590dcf441b09f4fe18bf3d8a7ce&scope.project.id=b38e380f92824682a8286e59af2fc23c&role.id=c1ad293fe0c443e98339ca975dc18549 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:20.452656 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4716b3-b06a-4c11-94e8-17e3d32d6bff None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:20.484840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113346ca-5eff-4745-a83d-ab24a7ad9d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:20.485838 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113346ca-5eff-4745-a83d-ab24a7ad9d6b None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:20.486330 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113346ca-5eff-4745-a83d-ab24a7ad9d6b None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:20.486783 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113346ca-5eff-4745-a83d-ab24a7ad9d6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:20.501583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113346ca-5eff-4745-a83d-ab24a7ad9d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:20.503883 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113346ca-5eff-4745-a83d-ab24a7ad9d6b None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:20.521353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-113346ca-5eff-4745-a83d-ab24a7ad9d6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:20.521353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:20.521353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:20.521353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:20.521353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:20.521353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:20.521353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:20.521353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:20.521353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:20.521353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:20.521353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:20.521353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:20.521353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:20.521353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:20.521353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:20.521353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:20.522602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:20.523913 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:20.523913 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:20.523913 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:20.523913 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 251/519] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:20.523913 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113346ca-5eff-4745-a83d-ab24a7ad9d6b None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:20.576494 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:20.596154 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4716b3-b06a-4c11-94e8-17e3d32d6bff None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:20.634542 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ec74d-02bb-469e-adbc-36d2c5144bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:20.636369 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec74d-02bb-469e-adbc-36d2c5144bdf None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:20.636721 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec74d-02bb-469e-adbc-36d2c5144bdf None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:20.637033 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec74d-02bb-469e-adbc-36d2c5144bdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:20.644825 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ec74d-02bb-469e-adbc-36d2c5144bdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:20.646287 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ec74d-02bb-469e-adbc-36d2c5144bdf None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:20.650419 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113346ca-5eff-4745-a83d-ab24a7ad9d6b None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:20.659805 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:20.662586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-d92ec74d-02bb-469e-adbc-36d2c5144bdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:20.662586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:20.662586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:20.662586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:20.662586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:20.662586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:20.662586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:20.662586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:20.662586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:20.662586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:20.662586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:20.662586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:20.662586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:11:20.662586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:11:20.662586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:20.663426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:20.664259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:11:20.664259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:11:20.664259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:11:20.664259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:11:20.664259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:11:20.664259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:11:20.664259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:20.664259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:20.664259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 269/520] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:20.665294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ec74d-02bb-469e-adbc-36d2c5144bdf None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:20.691416 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75658e5-22fd-423b-aaa1-2dac3d25f35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:20.692051 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75658e5-22fd-423b-aaa1-2dac3d25f35f None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:20.692332 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75658e5-22fd-423b-aaa1-2dac3d25f35f None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:20.692606 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75658e5-22fd-423b-aaa1-2dac3d25f35f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:20.705800 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75658e5-22fd-423b-aaa1-2dac3d25f35f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:20.707368 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75658e5-22fd-423b-aaa1-2dac3d25f35f None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:20.724067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-d75658e5-22fd-423b-aaa1-2dac3d25f35f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:20.724067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:20.724067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:20.724067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:20.724067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:20.724067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:20.724067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:20.724067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:20.724067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:20.724067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:20.724067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:20.724067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:20.724067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:20.724067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:20.724067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:20.724067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:20.725247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:20.726098 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:20.726098 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:20.726098 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:20.726098 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 252/521] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:20.726098 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75658e5-22fd-423b-aaa1-2dac3d25f35f None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:20.783985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ec74d-02bb-469e-adbc-36d2c5144bdf None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:20.821917 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a18498-eed2-4f3d-a7ee-98c267a3f8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:20.822528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a18498-eed2-4f3d-a7ee-98c267a3f8d5 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:20.822809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a18498-eed2-4f3d-a7ee-98c267a3f8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:20.823109 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a18498-eed2-4f3d-a7ee-98c267a3f8d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:20.824748 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a18498-eed2-4f3d-a7ee-98c267a3f8d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:20.825376 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a18498-eed2-4f3d-a7ee-98c267a3f8d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:20.826497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a18498-eed2-4f3d-a7ee-98c267a3f8d5 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:20.843363 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 270/522] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:20.843363 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a18498-eed2-4f3d-a7ee-98c267a3f8d5 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:20.843363 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:20.851621 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75658e5-22fd-423b-aaa1-2dac3d25f35f None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:20.890135 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ef0fc-d409-499e-83aa-34651554c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:20.890862 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ef0fc-d409-499e-83aa-34651554c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:20.891141 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ef0fc-d409-499e-83aa-34651554c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:20.891533 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ef0fc-d409-499e-83aa-34651554c2b2 None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:20.892231 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ef0fc-d409-499e-83aa-34651554c2b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:20.892601 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ef0fc-d409-499e-83aa-34651554c2b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:20.894242 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ef0fc-d409-499e-83aa-34651554c2b2 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:20.913758 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 253/523] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:11:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:20.913758 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ef0fc-d409-499e-83aa-34651554c2b2 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:20.935513 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:20.952754 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a18498-eed2-4f3d-a7ee-98c267a3f8d5 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:20.991255 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c554e-8378-4691-b475-310d36a9a032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:20.992020 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c554e-8378-4691-b475-310d36a9a032 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:20.992300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c554e-8378-4691-b475-310d36a9a032 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:20.993200 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c554e-8378-4691-b475-310d36a9a032 None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:20.993973 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c554e-8378-4691-b475-310d36a9a032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:20.994354 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c554e-8378-4691-b475-310d36a9a032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:20.995921 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c554e-8378-4691-b475-310d36a9a032 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:21.012169 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 271/524] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:21.012169 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c554e-8378-4691-b475-310d36a9a032 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:21.030277 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ef0fc-d409-499e-83aa-34651554c2b2 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:21.067350 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adb86d-f51e-47a6-8e2a-2191de3e939c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:21.067898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adb86d-f51e-47a6-8e2a-2191de3e939c None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:21.068175 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adb86d-f51e-47a6-8e2a-2191de3e939c None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:21.068443 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adb86d-f51e-47a6-8e2a-2191de3e939c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:21.076345 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adb86d-f51e-47a6-8e2a-2191de3e939c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:21.077900 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adb86d-f51e-47a6-8e2a-2191de3e939c None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:21.078526 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:21.089590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-e8adb86d-f51e-47a6-8e2a-2191de3e939c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:21.089590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:21.089590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:21.089590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:21.089590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:21.089590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:21.089590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:21.089590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:21.089590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:21.089590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:21.089590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:21.089590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:21.089590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:11:21.089590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:11:21.089590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:21.094113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:21.094971 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:11:21.094971 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:11:21.094971 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:11:21.094971 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:11:21.094971 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:11:21.094971 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:11:21.094971 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:21.094971 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:21.094971 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 254/525] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:21.094971 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adb86d-f51e-47a6-8e2a-2191de3e939c None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:21.123371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c554e-8378-4691-b475-310d36a9a032 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:21.161120 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b36257-8f91-4f4c-b3c0-08356b16e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:21.161760 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b36257-8f91-4f4c-b3c0-08356b16e4aa None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:21.162078 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b36257-8f91-4f4c-b3c0-08356b16e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:21.162275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b36257-8f91-4f4c-b3c0-08356b16e4aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:21.163007 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b36257-8f91-4f4c-b3c0-08356b16e4aa None admin] RBAC: Adding query filter params (role.id=c1ad293fe0c443e98339ca975dc18549, scope.project.id=b38e380f92824682a8286e59af2fc23c, user.id=0cd2faa457434dc6bfec69ecfa952ed4) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:21.163310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b36257-8f91-4f4c-b3c0-08356b16e4aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:21.165090 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b36257-8f91-4f4c-b3c0-08356b16e4aa None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:21.172825 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 272/526] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:11:21 2022] GET /identity/v3/role_assignments?user.id=0cd2faa457434dc6bfec69ecfa952ed4&scope.project.id=b38e380f92824682a8286e59af2fc23c&role.id=c1ad293fe0c443e98339ca975dc18549 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:21.174367 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b36257-8f91-4f4c-b3c0-08356b16e4aa None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:21.208082 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:21.238504 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adb86d-f51e-47a6-8e2a-2191de3e939c None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:21.283220 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b5fe0-6e32-4628-9683-6d07f2b2cd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:21.283868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b5fe0-6e32-4628-9683-6d07f2b2cd0c None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:21.284150 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b5fe0-6e32-4628-9683-6d07f2b2cd0c None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:21.284421 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b5fe0-6e32-4628-9683-6d07f2b2cd0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:21.293149 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b5fe0-6e32-4628-9683-6d07f2b2cd0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:21.294786 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b5fe0-6e32-4628-9683-6d07f2b2cd0c None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:21.307616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-5b4b5fe0-6e32-4628-9683-6d07f2b2cd0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:21.307616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:21.307616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:21.307616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:21.307616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:21.307616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:21.307616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:21.307616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:21.307616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:21.307616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:21.307616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:21.307616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:21.307616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:11:21.307616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:11:21.307616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:21.308585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:21.309462 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:11:21.309462 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:11:21.309462 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:11:21.309462 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:11:21.309462 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:11:21.309462 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:11:21.309462 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:21.309462 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:21.310337 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 255/527] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:21.314074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b36257-8f91-4f4c-b3c0-08356b16e4aa None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:21.315933 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b5fe0-6e32-4628-9683-6d07f2b2cd0c None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:21.352073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:21.364552 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602f269-52a7-420a-b119-e2bafdcd9331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:21.365481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602f269-52a7-420a-b119-e2bafdcd9331 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:21.365933 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602f269-52a7-420a-b119-e2bafdcd9331 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:21.366204 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602f269-52a7-420a-b119-e2bafdcd9331 None admin] PATH_INFO: `/v3/projects` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:21.366903 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602f269-52a7-420a-b119-e2bafdcd9331 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:21.367201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602f269-52a7-420a-b119-e2bafdcd9331 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:21.369372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602f269-52a7-420a-b119-e2bafdcd9331 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:21.396950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 273/528] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:11:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:21.399968 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602f269-52a7-420a-b119-e2bafdcd9331 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:21.440572 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b5fe0-6e32-4628-9683-6d07f2b2cd0c None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:21.483607 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa4ee1-ffe4-45ee-9c4d-4393a7b78506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:21.485124 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa4ee1-ffe4-45ee-9c4d-4393a7b78506 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:21.485880 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa4ee1-ffe4-45ee-9c4d-4393a7b78506 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:21.486387 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa4ee1-ffe4-45ee-9c4d-4393a7b78506 None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:21.487622 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa4ee1-ffe4-45ee-9c4d-4393a7b78506 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:21.489072 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa4ee1-ffe4-45ee-9c4d-4393a7b78506 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:21.490739 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa4ee1-ffe4-45ee-9c4d-4393a7b78506 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:21.505440 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:21.511793 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 256/529] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:11:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:21.518059 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa4ee1-ffe4-45ee-9c4d-4393a7b78506 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:21.524177 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602f269-52a7-420a-b119-e2bafdcd9331 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:21.568519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a0cd0-6155-4673-81d1-7a33fd5fc567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:21.569266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a0cd0-6155-4673-81d1-7a33fd5fc567 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:21.569546 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a0cd0-6155-4673-81d1-7a33fd5fc567 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:21.569864 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a0cd0-6155-4673-81d1-7a33fd5fc567 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:21.570597 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a0cd0-6155-4673-81d1-7a33fd5fc567 None admin] RBAC: Adding query filter params (role.id=c1ad293fe0c443e98339ca975dc18549, scope.project.id=b38e380f92824682a8286e59af2fc23c, user.id=1d273bdfc2d147ba9392544f9e8831a2) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:21.570902 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a0cd0-6155-4673-81d1-7a33fd5fc567 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:21.572939 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a0cd0-6155-4673-81d1-7a33fd5fc567 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:21.585009 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 274/530] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:11:21 2022] GET /identity/v3/role_assignments?user.id=1d273bdfc2d147ba9392544f9e8831a2&scope.project.id=b38e380f92824682a8286e59af2fc23c&role.id=c1ad293fe0c443e98339ca975dc18549 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:21.651918 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa4ee1-ffe4-45ee-9c4d-4393a7b78506 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:21.691811 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444093d0-6c21-469d-bda2-6962120a8744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:21.692795 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444093d0-6c21-469d-bda2-6962120a8744 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:21.693300 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444093d0-6c21-469d-bda2-6962120a8744 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:21.693784 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444093d0-6c21-469d-bda2-6962120a8744 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:21.694717 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444093d0-6c21-469d-bda2-6962120a8744 None admin] RBAC: Adding query filter params (role.id=c1ad293fe0c443e98339ca975dc18549, scope.project.id=b38e380f92824682a8286e59af2fc23c, user.id=51d3ab73e09b4d94b06df7eaf1d8b85e) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:21.695220 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444093d0-6c21-469d-bda2-6962120a8744 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:21.696899 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444093d0-6c21-469d-bda2-6962120a8744 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:21.704118 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 257/531] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:11:21 2022] GET /identity/v3/role_assignments?user.id=51d3ab73e09b4d94b06df7eaf1d8b85e&scope.project.id=b38e380f92824682a8286e59af2fc23c&role.id=c1ad293fe0c443e98339ca975dc18549 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:22.707220 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84c782-b1cd-451d-b8fc-d158a641852e None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:22.707765 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84c782-b1cd-451d-b8fc-d158a641852e None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:22.707765 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84c782-b1cd-451d-b8fc-d158a641852e None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:22.709565 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 275/532] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:22.716355 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65439c-fc2b-4f9e-9fc0-abdd7c97a3bc None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:22.716902 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65439c-fc2b-4f9e-9fc0-abdd7c97a3bc None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:22.716982 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65439c-fc2b-4f9e-9fc0-abdd7c97a3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:22.736801 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-bb65439c-fc2b-4f9e-9fc0-abdd7c97a3bc None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:22.738035 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-bb65439c-fc2b-4f9e-9fc0-abdd7c97a3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:22.801449 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:22.815936 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 258/533] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:23.146004 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84c782-b1cd-451d-b8fc-d158a641852e None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:23.206117 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:23.259176 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84c782-b1cd-451d-b8fc-d158a641852e None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:23.294392 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50f334-5abd-4e53-ba16-7557bf7adf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:23.295881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50f334-5abd-4e53-ba16-7557bf7adf0b None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:23.296216 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50f334-5abd-4e53-ba16-7557bf7adf0b None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:23.296485 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50f334-5abd-4e53-ba16-7557bf7adf0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:23.307220 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b50f334-5abd-4e53-ba16-7557bf7adf0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:23.313327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-9b50f334-5abd-4e53-ba16-7557bf7adf0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:23.313327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:23.313327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:23.313327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:23.313327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:23.313327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:23.313327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:23.313327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:23.313327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:23.313327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:23.313327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:23.313327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:23.313327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:23.313327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:23.313327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:23.313327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:23.314243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:23.314243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:23.314243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:23.314243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:23.314243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:23.314243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:23.314243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:23.314243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:23.314243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:23.314243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:23.314243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:23.314243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:23.314243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:23.314243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:23.314243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:23.314243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:23.315032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:23.315032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:23.315032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:23.315032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:23.315032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:23.315032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:23.315032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:23.315032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:23.315032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:23.315032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:23.315032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:23.315032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:23.315032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 276/534] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:11:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:23.321025 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65439c-fc2b-4f9e-9fc0-abdd7c97a3bc None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:23.444237 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65439c-fc2b-4f9e-9fc0-abdd7c97a3bc None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:23.486328 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fde49-d931-4d1a-9765-9edb940701dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:23.487227 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fde49-d931-4d1a-9765-9edb940701dc None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:23.487649 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fde49-d931-4d1a-9765-9edb940701dc None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:23.488025 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fde49-d931-4d1a-9765-9edb940701dc None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:23.489052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fde49-d931-4d1a-9765-9edb940701dc None admin] RBAC: Adding query filter params (name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:23.489362 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fde49-d931-4d1a-9765-9edb940701dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:23.490753 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fde49-d931-4d1a-9765-9edb940701dc None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:23.504498 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 259/535] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Aug 19 01:11:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:23.505894 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50f334-5abd-4e53-ba16-7557bf7adf0b None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:23.539708 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3bebf-04bc-46e6-b955-f75b8c9aaa40 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:23.540014 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3bebf-04bc-46e6-b955-f75b8c9aaa40 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:23.540267 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3bebf-04bc-46e6-b955-f75b8c9aaa40 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:23.542461 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 260/536] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:23.548335 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998dfd5-d268-412d-912d-4b5897a2e038 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:23.548609 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998dfd5-d268-412d-912d-4b5897a2e038 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:23.548932 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998dfd5-d268-412d-912d-4b5897a2e038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:23.569479 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-9998dfd5-d268-412d-912d-4b5897a2e038 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:23.570679 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-9998dfd5-d268-412d-912d-4b5897a2e038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:23.612270 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50f334-5abd-4e53-ba16-7557bf7adf0b None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:23.623358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:23.633242 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:23.647723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904f716-4b1d-418e-903a-374c87097e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:23.648349 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904f716-4b1d-418e-903a-374c87097e40 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:23.648620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904f716-4b1d-418e-903a-374c87097e40 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:23.648923 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904f716-4b1d-418e-903a-374c87097e40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:23.657105 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 261/537] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:11:23.660789 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904f716-4b1d-418e-903a-374c87097e40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:23.662278 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904f716-4b1d-418e-903a-374c87097e40 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:23.678691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-8904f716-4b1d-418e-903a-374c87097e40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:23.678691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:23.678691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:23.678691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:23.678691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:23.678691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:23.678691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:23.678691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:23.678691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:23.678691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:23.678691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:23.678691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:23.678691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:23.678691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:23.678691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:23.678691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:23.684272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:23.685211 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:23.685211 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:23.685211 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:23.685211 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 277/538] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:23.687082 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998dfd5-d268-412d-912d-4b5897a2e038 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:23.803436 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998dfd5-d268-412d-912d-4b5897a2e038 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:23.845836 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805479f2-9051-4f42-bcb3-2cf3734d7826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:23.846447 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805479f2-9051-4f42-bcb3-2cf3734d7826 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:23.846726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805479f2-9051-4f42-bcb3-2cf3734d7826 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:23.847000 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805479f2-9051-4f42-bcb3-2cf3734d7826 None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:23.847647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805479f2-9051-4f42-bcb3-2cf3734d7826 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:23.847948 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805479f2-9051-4f42-bcb3-2cf3734d7826 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:23.849527 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805479f2-9051-4f42-bcb3-2cf3734d7826 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:23.866735 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 262/539] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:23.868730 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904f716-4b1d-418e-903a-374c87097e40 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:23.892215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28832171-ed4a-4940-93dc-9acefbc55116 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:23.892528 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28832171-ed4a-4940-93dc-9acefbc55116 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:23.892775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28832171-ed4a-4940-93dc-9acefbc55116 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:23.894399 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 263/540] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:11:23.899675 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f398b8-845d-4552-b421-a7c8564c8004 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:23.899962 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f398b8-845d-4552-b421-a7c8564c8004 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:23.900235 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f398b8-845d-4552-b421-a7c8564c8004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:23.920970 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-36f398b8-845d-4552-b421-a7c8564c8004 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:23.922275 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-36f398b8-845d-4552-b421-a7c8564c8004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:23.973041 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:23.990844 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904f716-4b1d-418e-903a-374c87097e40 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:24.008877 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 264/541] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:24.008877 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a71d99-8d60-4702-b606-09152d5ea7e5 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:24.008877 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a71d99-8d60-4702-b606-09152d5ea7e5 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:24.008877 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a71d99-8d60-4702-b606-09152d5ea7e5 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:24.008877 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 265/542] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:24.009946 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b2388-c32f-4fcd-85b4-bb12aecb903e None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:24.010228 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b2388-c32f-4fcd-85b4-bb12aecb903e None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:24.011090 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b2388-c32f-4fcd-85b4-bb12aecb903e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:24.032072 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-cf4b2388-c32f-4fcd-85b4-bb12aecb903e None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:24.033334 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-cf4b2388-c32f-4fcd-85b4-bb12aecb903e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:24.034760 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01c9b5-edb4-4c6b-a32b-2a9244a4e1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:24.035399 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01c9b5-edb4-4c6b-a32b-2a9244a4e1f8 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:24.035662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01c9b5-edb4-4c6b-a32b-2a9244a4e1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:24.035940 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01c9b5-edb4-4c6b-a32b-2a9244a4e1f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:24.043759 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01c9b5-edb4-4c6b-a32b-2a9244a4e1f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:24.045255 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01c9b5-edb4-4c6b-a32b-2a9244a4e1f8 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:24.056429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-7f01c9b5-edb4-4c6b-a32b-2a9244a4e1f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 01:11:24.056429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:24.056429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:24.056429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:24.056429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:24.056429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:24.056429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:24.056429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:24.056429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:24.056429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:24.056429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:24.056429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:24.056429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:11:24.056429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:11:24.056429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:11:24.056429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:24.057449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:24.063053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:24.063053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:24.063053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:11:24.063053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:11:24.063053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:11:24.063053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:11:24.063053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:11:24.063053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:11:24.063053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 01:11:24.063053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:24.063053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 278/543] 10.222.0.82 () {56 vars in 1093 bytes} [Fri Aug 19 01:11:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:24.063053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01c9b5-edb4-4c6b-a32b-2a9244a4e1f8 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:24.087553 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:24.105978 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 266/544] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:24.106731 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b2388-c32f-4fcd-85b4-bb12aecb903e None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:24.194039 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01c9b5-edb4-4c6b-a32b-2a9244a4e1f8 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:24.229760 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9bd96-e447-4542-88b9-792e578e7cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:24.230858 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9bd96-e447-4542-88b9-792e578e7cdc None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:24.230994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9bd96-e447-4542-88b9-792e578e7cdc None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:24.231209 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9bd96-e447-4542-88b9-792e578e7cdc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:24.234932 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b2388-c32f-4fcd-85b4-bb12aecb903e None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:24.242386 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9bd96-e447-4542-88b9-792e578e7cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:24.244505 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:24.248302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-24c9bd96-e447-4542-88b9-792e578e7cdc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:24.248302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:24.248302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:24.248302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:24.248302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:24.248302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:24.248302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:24.248302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:24.248302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:24.248302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:24.248302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:24.248302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:24.248302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:24.248302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:24.248302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:24.248302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:24.249318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:24.249318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:24.249318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:24.249318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:24.249318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:24.249318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:24.249318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:24.249318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:24.249318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:24.249318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:24.249318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:24.249318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:24.249318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:24.249318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:24.249318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:24.249318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:24.250258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:24.250258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:24.250258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:24.250258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:24.250258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:24.250258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:24.250258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:24.250258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:24.250258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:24.250258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:24.250258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:24.250258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:24.254603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 279/545] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:11:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:24.261806 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9bd96-e447-4542-88b9-792e578e7cdc None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:24.285547 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25eb6b-41dd-408e-ae26-e597be8efc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:24.287127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25eb6b-41dd-408e-ae26-e597be8efc57 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:24.287561 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25eb6b-41dd-408e-ae26-e597be8efc57 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:24.288293 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25eb6b-41dd-408e-ae26-e597be8efc57 None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:24.289805 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25eb6b-41dd-408e-ae26-e597be8efc57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:24.290371 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25eb6b-41dd-408e-ae26-e597be8efc57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:24.292529 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25eb6b-41dd-408e-ae26-e597be8efc57 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:24.340382 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 267/546] 10.222.0.82 () {56 vars in 1133 bytes} [Fri Aug 19 01:11:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:24.341594 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25eb6b-41dd-408e-ae26-e597be8efc57 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:24.343356 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:24.362703 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9bd96-e447-4542-88b9-792e578e7cdc None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:24.400356 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ec49a-2ef9-4764-9f6c-34c249737d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:24.400991 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ec49a-2ef9-4764-9f6c-34c249737d7e None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:24.401850 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ec49a-2ef9-4764-9f6c-34c249737d7e None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:24.402164 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ec49a-2ef9-4764-9f6c-34c249737d7e None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:24.402874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ec49a-2ef9-4764-9f6c-34c249737d7e None admin] RBAC: Adding query filter params (name=service) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:24.403207 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ec49a-2ef9-4764-9f6c-34c249737d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:24.404577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ec49a-2ef9-4764-9f6c-34c249737d7e None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:24.417577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 280/547] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Aug 19 01:11:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:24.417577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ec49a-2ef9-4764-9f6c-34c249737d7e None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:24.454764 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25eb6b-41dd-408e-ae26-e597be8efc57 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:24.489341 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80de41-64af-4eb3-8f3b-53d9815ca2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:24.489966 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80de41-64af-4eb3-8f3b-53d9815ca2ba None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:24.490246 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80de41-64af-4eb3-8f3b-53d9815ca2ba None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:24.490524 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80de41-64af-4eb3-8f3b-53d9815ca2ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:24.500925 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80de41-64af-4eb3-8f3b-53d9815ca2ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:24.505736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-ec80de41-64af-4eb3-8f3b-53d9815ca2ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:24.505736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:24.505736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:24.505736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:24.505736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:24.505736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:24.505736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:24.505736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:24.505736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:24.505736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:24.505736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:24.505736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:24.505736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:24.505736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:24.505736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:24.505736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:24.506772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:24.506772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:24.506772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:24.506772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:24.506772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:24.506772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:24.506772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:24.506772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:24.506772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:24.506772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:24.506772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:24.506772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:24.506772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:24.506772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:24.506772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:24.506772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:24.509980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:24.509980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:24.509980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:24.509980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:24.509980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:24.509980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:24.509980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:24.509980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:24.509980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:24.509980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:24.509980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:24.509980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:24.509980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 268/548] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:11:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:24.509980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80de41-64af-4eb3-8f3b-53d9815ca2ba None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:24.519376 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ec49a-2ef9-4764-9f6c-34c249737d7e None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:24.535358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:24.562322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472631ba-b9c3-4f65-93b4-f34ea99b0710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:24.562962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472631ba-b9c3-4f65-93b4-f34ea99b0710 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:24.563241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472631ba-b9c3-4f65-93b4-f34ea99b0710 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:24.563514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472631ba-b9c3-4f65-93b4-f34ea99b0710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:24.575013 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472631ba-b9c3-4f65-93b4-f34ea99b0710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:24.576521 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472631ba-b9c3-4f65-93b4-f34ea99b0710 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:24.579019 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:24.591283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-472631ba-b9c3-4f65-93b4-f34ea99b0710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:24.591283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:24.591283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:24.591283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:24.591283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:24.591283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:24.591283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:24.591283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:24.591283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:24.591283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:24.591283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:24.591283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:24.591283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:24.591283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:24.591283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:24.591283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:24.592322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:24.593209 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:24.593209 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:24.593209 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:24.593209 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 281/549] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:24.593942 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472631ba-b9c3-4f65-93b4-f34ea99b0710 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:24.614978 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80de41-64af-4eb3-8f3b-53d9815ca2ba None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:24.649258 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545f747-efe4-475e-bfc9-5509cd5ac9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:24.649885 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545f747-efe4-475e-bfc9-5509cd5ac9bd None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:24.650162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545f747-efe4-475e-bfc9-5509cd5ac9bd None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:24.650432 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545f747-efe4-475e-bfc9-5509cd5ac9bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:24.660709 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545f747-efe4-475e-bfc9-5509cd5ac9bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:24.662712 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545f747-efe4-475e-bfc9-5509cd5ac9bd None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:24.678835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-8545f747-efe4-475e-bfc9-5509cd5ac9bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:24.678835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:24.678835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:24.678835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:24.678835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:24.678835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:24.678835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:24.678835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:24.678835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:24.678835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:24.678835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:24.678835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:24.678835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:24.678835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:24.678835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:24.678835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:24.679961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:24.681584 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:24.681584 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:24.681584 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:24.681584 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 269/550] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:24.681584 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545f747-efe4-475e-bfc9-5509cd5ac9bd None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:24.698105 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472631ba-b9c3-4f65-93b4-f34ea99b0710 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:24.735816 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff77dd9-9cf7-44fa-a20d-0c399ea0aef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:24.736443 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff77dd9-9cf7-44fa-a20d-0c399ea0aef9 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:24.736719 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff77dd9-9cf7-44fa-a20d-0c399ea0aef9 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:24.737030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff77dd9-9cf7-44fa-a20d-0c399ea0aef9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:24.747165 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff77dd9-9cf7-44fa-a20d-0c399ea0aef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:24.753641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-8ff77dd9-9cf7-44fa-a20d-0c399ea0aef9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:24.753641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:24.753641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:24.753641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:24.753641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:24.753641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:24.753641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:24.753641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:24.753641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:24.753641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:24.753641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:24.753641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:24.753641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:24.753641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:24.753641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:24.753641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:24.754677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:24.754677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:24.754677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:24.754677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:24.754677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:24.754677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:24.754677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:24.754677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:24.754677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:24.754677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:24.754677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:24.754677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:24.754677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:24.754677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:24.754677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:24.754677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:24.755576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:24.755576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:24.755576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:24.755576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:24.755576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:24.755576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:24.755576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:24.755576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:24.755576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:24.755576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:24.755576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:24.755576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:24.755576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 282/551] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:11:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:24.755576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff77dd9-9cf7-44fa-a20d-0c399ea0aef9 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:24.770162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:24.792799 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545f747-efe4-475e-bfc9-5509cd5ac9bd None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:24.811388 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:24.831225 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d1f25-0ecf-456e-aaa6-1c9c508135ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:24.831890 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d1f25-0ecf-456e-aaa6-1c9c508135ac None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:24.832169 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d1f25-0ecf-456e-aaa6-1c9c508135ac None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:24.832435 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d1f25-0ecf-456e-aaa6-1c9c508135ac None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:24.833118 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d1f25-0ecf-456e-aaa6-1c9c508135ac None admin] RBAC: Adding query filter params (name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:24.833416 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d1f25-0ecf-456e-aaa6-1c9c508135ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:24.834783 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d1f25-0ecf-456e-aaa6-1c9c508135ac None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:24.842617 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 270/552] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Aug 19 01:11:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:24.843319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d1f25-0ecf-456e-aaa6-1c9c508135ac None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:24.859073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff77dd9-9cf7-44fa-a20d-0c399ea0aef9 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:24.894217 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356521-6efc-4943-a341-efde15c024c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:24.894903 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356521-6efc-4943-a341-efde15c024c1 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:24.895090 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356521-6efc-4943-a341-efde15c024c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:24.895341 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356521-6efc-4943-a341-efde15c024c1 None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:24.895967 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef356521-6efc-4943-a341-efde15c024c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:24.896265 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef356521-6efc-4943-a341-efde15c024c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:24.897916 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef356521-6efc-4943-a341-efde15c024c1 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:24.909292 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 283/553] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:24.910079 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356521-6efc-4943-a341-efde15c024c1 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:24.944329 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d1f25-0ecf-456e-aaa6-1c9c508135ac None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:24.978093 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f713e2-cf64-442f-b6c2-724dd04566d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:24.978687 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f713e2-cf64-442f-b6c2-724dd04566d1 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:24.978961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f713e2-cf64-442f-b6c2-724dd04566d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:24.979793 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f713e2-cf64-442f-b6c2-724dd04566d1 None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:24.980634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f713e2-cf64-442f-b6c2-724dd04566d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:24.981548 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f713e2-cf64-442f-b6c2-724dd04566d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:24.982348 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f713e2-cf64-442f-b6c2-724dd04566d1 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:24.989508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:24.994354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 271/554] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:24.995207 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f713e2-cf64-442f-b6c2-724dd04566d1 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:25.010375 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356521-6efc-4943-a341-efde15c024c1 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:25.027645 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:25.045701 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f591c31-e9f0-4a89-bcee-50a10bbcb397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:25.046354 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f591c31-e9f0-4a89-bcee-50a10bbcb397 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:25.046635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f591c31-e9f0-4a89-bcee-50a10bbcb397 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:25.046906 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f591c31-e9f0-4a89-bcee-50a10bbcb397 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:25.047610 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f591c31-e9f0-4a89-bcee-50a10bbcb397 None admin] RBAC: Adding query filter params (name=service) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:25.047913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f591c31-e9f0-4a89-bcee-50a10bbcb397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:25.049310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f591c31-e9f0-4a89-bcee-50a10bbcb397 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:25.057123 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 284/555] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Aug 19 01:11:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:25.058421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f591c31-e9f0-4a89-bcee-50a10bbcb397 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:25.098232 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f713e2-cf64-442f-b6c2-724dd04566d1 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:25.132150 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712abc3-10c0-488a-83a7-4752e06a9be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:25.132768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712abc3-10c0-488a-83a7-4752e06a9be3 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:25.133075 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712abc3-10c0-488a-83a7-4752e06a9be3 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:25.133353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712abc3-10c0-488a-83a7-4752e06a9be3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:25.143762 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712abc3-10c0-488a-83a7-4752e06a9be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:25.145261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712abc3-10c0-488a-83a7-4752e06a9be3 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:25.156043 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f591c31-e9f0-4a89-bcee-50a10bbcb397 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:25.160525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-c712abc3-10c0-488a-83a7-4752e06a9be3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:25.160525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:25.160525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:25.160525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:25.160525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:25.160525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:25.160525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:25.160525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:25.160525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:25.160525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:25.160525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:25.160525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:25.160525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:25.160525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:25.160525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:25.160525 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:25.161487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:25.162375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:25.162375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:25.162375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:25.162375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 272/556] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:25.162375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712abc3-10c0-488a-83a7-4752e06a9be3 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:25.193348 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b6df0-1e68-4649-be13-4d9a8b78c0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:25.194029 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b6df0-1e68-4649-be13-4d9a8b78c0b1 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:25.194303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b6df0-1e68-4649-be13-4d9a8b78c0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:25.194572 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b6df0-1e68-4649-be13-4d9a8b78c0b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:25.201026 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b6df0-1e68-4649-be13-4d9a8b78c0b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:25.202445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b6df0-1e68-4649-be13-4d9a8b78c0b1 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:25.211826 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:25.213458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-8f6b6df0-1e68-4649-be13-4d9a8b78c0b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:25.213458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:25.213458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:25.213458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:25.213458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:25.213458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:25.213458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:25.213458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:25.213458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:25.213458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:25.213458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:25.213458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:25.213458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:11:25.213458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:11:25.213458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:25.215336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:25.216365 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:11:25.216365 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:11:25.216365 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:11:25.216365 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:11:25.216365 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:11:25.216365 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:11:25.216365 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:25.216365 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:25.216365 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 285/557] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:25.216934 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b6df0-1e68-4649-be13-4d9a8b78c0b1 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:25.259298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:25.266968 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712abc3-10c0-488a-83a7-4752e06a9be3 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:25.301229 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06e183-4ea7-4303-b252-016371fab098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:25.301862 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e183-4ea7-4303-b252-016371fab098 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:25.302141 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e183-4ea7-4303-b252-016371fab098 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:25.302415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e183-4ea7-4303-b252-016371fab098 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:25.309926 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06e183-4ea7-4303-b252-016371fab098 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:25.311390 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06e183-4ea7-4303-b252-016371fab098 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:25.319447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b6df0-1e68-4649-be13-4d9a8b78c0b1 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:25.322410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-aa06e183-4ea7-4303-b252-016371fab098 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 01:11:25.322410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:25.322410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:25.322410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:25.322410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:25.322410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:25.322410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:25.322410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:25.322410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:25.322410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:25.322410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:25.322410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:25.322410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:11:25.322410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:11:25.322410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:11:25.322410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:25.324015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:25.325001 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:25.325001 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:25.325001 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:11:25.325001 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:11:25.325001 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:11:25.325001 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:11:25.325001 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:11:25.325001 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:11:25.325001 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 01:11:25.325001 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:25.325001 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 273/558] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:11:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:25.325001 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06e183-4ea7-4303-b252-016371fab098 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:25.352954 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab6ae5-b93c-4b3c-826b-c3b937aafbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:25.353562 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab6ae5-b93c-4b3c-826b-c3b937aafbeb None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:25.353835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab6ae5-b93c-4b3c-826b-c3b937aafbeb None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:25.354096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab6ae5-b93c-4b3c-826b-c3b937aafbeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:25.365373 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab6ae5-b93c-4b3c-826b-c3b937aafbeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:25.366898 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab6ae5-b93c-4b3c-826b-c3b937aafbeb None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:25.381282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-a2ab6ae5-b93c-4b3c-826b-c3b937aafbeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:25.381282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:25.381282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:25.381282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:25.381282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:25.381282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:25.381282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:25.381282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:25.381282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:25.381282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:25.381282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:25.381282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:25.381282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:25.381282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:25.381282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:25.381282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:25.382409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:25.383296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:25.383296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:25.383296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:25.383296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 286/559] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:25.383606 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab6ae5-b93c-4b3c-826b-c3b937aafbeb None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:25.434882 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06e183-4ea7-4303-b252-016371fab098 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:25.446215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:25.470591 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b5176-a9c0-436a-92f7-29d937661f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:25.471186 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b5176-a9c0-436a-92f7-29d937661f37 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:25.471461 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b5176-a9c0-436a-92f7-29d937661f37 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:25.471728 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b5176-a9c0-436a-92f7-29d937661f37 None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:25.472354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b5176-a9c0-436a-92f7-29d937661f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:25.472642 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b5176-a9c0-436a-92f7-29d937661f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:25.474047 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b5176-a9c0-436a-92f7-29d937661f37 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:25.478169 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:25.487236 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 274/560] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:25.487759 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab6ae5-b93c-4b3c-826b-c3b937aafbeb None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:25.488041 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b5176-a9c0-436a-92f7-29d937661f37 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:25.523163 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa683d6-f12d-44a6-b5e0-4f79e9f97b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:25.523765 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa683d6-f12d-44a6-b5e0-4f79e9f97b41 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:25.524039 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa683d6-f12d-44a6-b5e0-4f79e9f97b41 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:25.524313 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa683d6-f12d-44a6-b5e0-4f79e9f97b41 None admin] PATH_INFO: `/v3/projects` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:25.525034 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa683d6-f12d-44a6-b5e0-4f79e9f97b41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:25.525338 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa683d6-f12d-44a6-b5e0-4f79e9f97b41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:25.527911 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa683d6-f12d-44a6-b5e0-4f79e9f97b41 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:25.539824 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 287/561] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:11:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:25.540608 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa683d6-f12d-44a6-b5e0-4f79e9f97b41 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:25.595750 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b5176-a9c0-436a-92f7-29d937661f37 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:25.628739 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303a406-ea18-47c3-bcf3-17fbc93acbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:25.629290 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303a406-ea18-47c3-bcf3-17fbc93acbf0 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:25.629569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303a406-ea18-47c3-bcf3-17fbc93acbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:25.629840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303a406-ea18-47c3-bcf3-17fbc93acbf0 None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:25.630564 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303a406-ea18-47c3-bcf3-17fbc93acbf0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:25.630870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303a406-ea18-47c3-bcf3-17fbc93acbf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:25.632319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303a406-ea18-47c3-bcf3-17fbc93acbf0 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:25.642288 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa683d6-f12d-44a6-b5e0-4f79e9f97b41 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:25.649746 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 275/562] 10.222.0.82 () {56 vars in 1137 bytes} [Fri Aug 19 01:11:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:25.650541 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303a406-ea18-47c3-bcf3-17fbc93acbf0 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:25.679807 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af5c07-4c82-4b38-9f36-5ec394056a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:25.680412 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af5c07-4c82-4b38-9f36-5ec394056a7e None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:25.680545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:25.680688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af5c07-4c82-4b38-9f36-5ec394056a7e None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:25.680982 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af5c07-4c82-4b38-9f36-5ec394056a7e None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:25.681618 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af5c07-4c82-4b38-9f36-5ec394056a7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:25.681929 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af5c07-4c82-4b38-9f36-5ec394056a7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:25.683999 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af5c07-4c82-4b38-9f36-5ec394056a7e None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:25.695033 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 288/563] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:25.695785 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af5c07-4c82-4b38-9f36-5ec394056a7e None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:25.709503 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:25.755571 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303a406-ea18-47c3-bcf3-17fbc93acbf0 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:25.791769 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44237d-b46e-48ce-997d-391910cfa0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:25.793077 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44237d-b46e-48ce-997d-391910cfa0a6 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:25.793374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44237d-b46e-48ce-997d-391910cfa0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:25.793643 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44237d-b46e-48ce-997d-391910cfa0a6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:25.800644 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44237d-b46e-48ce-997d-391910cfa0a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:25.802198 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44237d-b46e-48ce-997d-391910cfa0a6 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:25.802299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af5c07-4c82-4b38-9f36-5ec394056a7e None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:25.813740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-3c44237d-b46e-48ce-997d-391910cfa0a6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 01:11:25.813740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:25.813740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:25.813740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:25.813740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:25.813740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:25.813740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:25.813740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:25.813740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:25.813740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:25.813740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:25.813740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:25.813740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:11:25.813740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:11:25.813740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:11:25.813740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:25.814824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:25.815773 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:25.815773 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:25.815773 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:11:25.815773 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:11:25.815773 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:11:25.815773 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:11:25.815773 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:11:25.815773 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:11:25.815773 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 01:11:25.815773 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:25.815773 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 276/564] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:11:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:25.815773 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44237d-b46e-48ce-997d-391910cfa0a6 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:25.838025 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3326f8-b439-4a9b-8a12-cd377d415987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:25.839199 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3326f8-b439-4a9b-8a12-cd377d415987 None admin] REQUEST_METHOD: `PUT` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:25.839554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3326f8-b439-4a9b-8a12-cd377d415987 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:25.839907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3326f8-b439-4a9b-8a12-cd377d415987 None admin] PATH_INFO: `/v3/projects/b38e380f92824682a8286e59af2fc23c/users/ea9fe590dcf441b09f4fe18bf3d8a7ce/roles/c1ad293fe0c443e98339ca975dc18549` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:25.854903 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3326f8-b439-4a9b-8a12-cd377d415987 None admin] RBAC: Authorizing `identity:create_grant(project_id=b38e380f92824682a8286e59af2fc23c, user_id=ea9fe590dcf441b09f4fe18bf3d8a7ce, role_id=c1ad293fe0c443e98339ca975dc18549)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:25.856536 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3326f8-b439-4a9b-8a12-cd377d415987 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:25.906559 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:25.922921 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44237d-b46e-48ce-997d-391910cfa0a6 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:25.958261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa481f1-b410-49f4-91b5-305b24bf08ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:25.958880 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa481f1-b410-49f4-91b5-305b24bf08ad None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:25.959155 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa481f1-b410-49f4-91b5-305b24bf08ad None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:25.959422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa481f1-b410-49f4-91b5-305b24bf08ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:25.969831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa481f1-b410-49f4-91b5-305b24bf08ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:25.971269 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa481f1-b410-49f4-91b5-305b24bf08ad None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:25.974334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 289/565] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Aug 19 01:11:25 2022] PUT /identity/v3/projects/b38e380f92824682a8286e59af2fc23c/users/ea9fe590dcf441b09f4fe18bf3d8a7ce/roles/c1ad293fe0c443e98339ca975dc18549 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:11:25.978593 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3326f8-b439-4a9b-8a12-cd377d415987 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:25.987740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-0fa481f1-b410-49f4-91b5-305b24bf08ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:25.987740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:25.987740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:25.987740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:25.987740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:25.987740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:25.987740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:25.987740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:25.987740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:25.987740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:25.987740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:25.987740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:25.987740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:25.987740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:25.987740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:25.987740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:25.988917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:25.990212 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:25.990212 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:25.990212 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:25.990212 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 277/566] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:25.990212 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa481f1-b410-49f4-91b5-305b24bf08ad None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:26.069655 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:26.126262 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa481f1-b410-49f4-91b5-305b24bf08ad None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:26.127037 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3326f8-b439-4a9b-8a12-cd377d415987 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:26.181512 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef0876-0b90-4952-a47a-da6975b3ca49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:26.182090 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef0876-0b90-4952-a47a-da6975b3ca49 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:26.182386 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef0876-0b90-4952-a47a-da6975b3ca49 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:26.182663 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef0876-0b90-4952-a47a-da6975b3ca49 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:26.184239 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971d193-942a-48d6-9a71-dd38d6155440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:26.184886 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971d193-942a-48d6-9a71-dd38d6155440 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:26.185202 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971d193-942a-48d6-9a71-dd38d6155440 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:26.186611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971d193-942a-48d6-9a71-dd38d6155440 None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:26.187366 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971d193-942a-48d6-9a71-dd38d6155440 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:26.187679 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971d193-942a-48d6-9a71-dd38d6155440 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:26.189169 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971d193-942a-48d6-9a71-dd38d6155440 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:26.191179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef0876-0b90-4952-a47a-da6975b3ca49 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:26.193374 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef0876-0b90-4952-a47a-da6975b3ca49 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:26.201753 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:26.212306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-d9ef0876-0b90-4952-a47a-da6975b3ca49 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 01:11:26.212306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:26.212306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:26.212306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:26.212306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:26.212306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:26.212306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:26.212306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:26.212306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:26.212306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:26.212306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:26.212306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:26.212306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:11:26.212306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:11:26.212306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:11:26.212306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:26.219994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:26.220985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:26.220985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:26.220985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:11:26.220985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:11:26.220985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:11:26.220985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:11:26.220985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:11:26.220985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:11:26.220985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 01:11:26.220985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:26.221527 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 278/567] 10.222.0.82 () {56 vars in 1137 bytes} [Fri Aug 19 01:11:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:26.221601 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 290/568] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:11:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:26.221667 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971d193-942a-48d6-9a71-dd38d6155440 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:26.221743 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef0876-0b90-4952-a47a-da6975b3ca49 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:26.348168 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef0876-0b90-4952-a47a-da6975b3ca49 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:26.359175 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971d193-942a-48d6-9a71-dd38d6155440 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:26.375170 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:26.392673 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e596f4-306f-445d-ab67-512a42b478a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:26.393744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e596f4-306f-445d-ab67-512a42b478a6 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:26.394025 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e596f4-306f-445d-ab67-512a42b478a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:26.394297 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e596f4-306f-445d-ab67-512a42b478a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:26.406709 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a939be-d4cf-4534-83bf-323163fde666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:26.407324 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a939be-d4cf-4534-83bf-323163fde666 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:26.407647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a939be-d4cf-4534-83bf-323163fde666 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:26.407910 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a939be-d4cf-4534-83bf-323163fde666 None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:26.408554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a939be-d4cf-4534-83bf-323163fde666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:26.408867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a939be-d4cf-4534-83bf-323163fde666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:26.410250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a939be-d4cf-4534-83bf-323163fde666 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:26.411408 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e596f4-306f-445d-ab67-512a42b478a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:26.413990 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e596f4-306f-445d-ab67-512a42b478a6 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:26.428790 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 279/569] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:26.428790 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a939be-d4cf-4534-83bf-323163fde666 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:26.437554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-75e596f4-306f-445d-ab67-512a42b478a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:26.437554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:26.437554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:26.437554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:26.437554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:26.437554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:26.437554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:26.437554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:26.437554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:26.437554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:26.437554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:26.437554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:26.437554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:26.437554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:26.437554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:26.437554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:26.438510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:26.444290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:26.444290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:26.444290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:26.444290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 291/570] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:11:26.444290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e596f4-306f-445d-ab67-512a42b478a6 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:26.509112 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:26.563524 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e596f4-306f-445d-ab67-512a42b478a6 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:26.568815 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a939be-d4cf-4534-83bf-323163fde666 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:26.606701 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f4db0-11e5-4c81-8746-819b82d48d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:26.607337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f4db0-11e5-4c81-8746-819b82d48d46 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:26.607613 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f4db0-11e5-4c81-8746-819b82d48d46 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:26.607892 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f4db0-11e5-4c81-8746-819b82d48d46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:26.615095 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f4db0-11e5-4c81-8746-819b82d48d46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:26.616760 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f4db0-11e5-4c81-8746-819b82d48d46 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:26.620695 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbc603-6a5d-413e-b9fb-1b30e2d717cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:26.621345 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbc603-6a5d-413e-b9fb-1b30e2d717cb None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:26.621628 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbc603-6a5d-413e-b9fb-1b30e2d717cb None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:26.621900 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbc603-6a5d-413e-b9fb-1b30e2d717cb None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:26.622638 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbc603-6a5d-413e-b9fb-1b30e2d717cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:26.622944 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbc603-6a5d-413e-b9fb-1b30e2d717cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:26.624737 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbc603-6a5d-413e-b9fb-1b30e2d717cb None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:26.630726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-214f4db0-11e5-4c81-8746-819b82d48d46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:26.630726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:26.630726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:26.630726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:26.630726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:26.630726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:26.630726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:26.630726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:26.630726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:26.630726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:26.630726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:26.630726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:26.630726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:11:26.630726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:11:26.630726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:26.631636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:26.632517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:11:26.632517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:11:26.632517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:11:26.632517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:11:26.632517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:11:26.632517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:11:26.632517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:26.632517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:26.637576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 292/571] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:26.638153 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f4db0-11e5-4c81-8746-819b82d48d46 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:26.651667 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 280/572] 10.222.0.82 () {56 vars in 1139 bytes} [Fri Aug 19 01:11:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:26.651667 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbc603-6a5d-413e-b9fb-1b30e2d717cb None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:26.685050 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:26.770012 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f4db0-11e5-4c81-8746-819b82d48d46 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:26.778039 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbc603-6a5d-413e-b9fb-1b30e2d717cb None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:26.797233 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:26.811729 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a84ea-caf1-480b-bc0b-bef045d7ea98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:26.812708 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a84ea-caf1-480b-bc0b-bef045d7ea98 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:26.813256 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a84ea-caf1-480b-bc0b-bef045d7ea98 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:26.813622 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a84ea-caf1-480b-bc0b-bef045d7ea98 None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:26.814275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a84ea-caf1-480b-bc0b-bef045d7ea98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:26.814699 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a84ea-caf1-480b-bc0b-bef045d7ea98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:26.816612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a84ea-caf1-480b-bc0b-bef045d7ea98 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:26.816716 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ae714-1f42-4aba-9b4d-6a8cf298474b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:26.817372 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ae714-1f42-4aba-9b4d-6a8cf298474b None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:26.817695 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ae714-1f42-4aba-9b4d-6a8cf298474b None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:26.818023 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ae714-1f42-4aba-9b4d-6a8cf298474b None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:26.818726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ae714-1f42-4aba-9b4d-6a8cf298474b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:26.819030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ae714-1f42-4aba-9b4d-6a8cf298474b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:26.820460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ae714-1f42-4aba-9b4d-6a8cf298474b None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:26.837449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 293/573] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:26.837449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a84ea-caf1-480b-bc0b-bef045d7ea98 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:26.837733 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 281/574] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:11:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:26.839170 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ae714-1f42-4aba-9b4d-6a8cf298474b None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:26.959349 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:26.969213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a84ea-caf1-480b-bc0b-bef045d7ea98 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:26.976309 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ae714-1f42-4aba-9b4d-6a8cf298474b None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:27.005242 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec796ae-d488-47af-a1fd-0a19499503b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:27.005876 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec796ae-d488-47af-a1fd-0a19499503b8 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:27.006158 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec796ae-d488-47af-a1fd-0a19499503b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:27.006432 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec796ae-d488-47af-a1fd-0a19499503b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:27.014838 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4205f-c0cc-4212-985a-990b3b839995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:27.015917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4205f-c0cc-4212-985a-990b3b839995 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:27.016219 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4205f-c0cc-4212-985a-990b3b839995 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:27.016498 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4205f-c0cc-4212-985a-990b3b839995 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:27.017667 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec796ae-d488-47af-a1fd-0a19499503b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:27.019123 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec796ae-d488-47af-a1fd-0a19499503b8 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:27.024805 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4205f-c0cc-4212-985a-990b3b839995 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:27.027324 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4205f-c0cc-4212-985a-990b3b839995 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:27.034774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-0ec796ae-d488-47af-a1fd-0a19499503b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:27.034774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:27.034774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:27.034774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:27.034774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:27.034774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:27.034774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:27.034774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:27.034774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:27.034774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:27.034774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:27.034774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:27.034774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:27.034774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:27.034774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:27.034774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:27.035716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:27.042008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:27.042008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:27.042008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:27.042008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 294/575] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:27.042008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec796ae-d488-47af-a1fd-0a19499503b8 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:27.042374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-64e4205f-c0cc-4212-985a-990b3b839995 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:27.042374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:27.042374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:27.042374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:27.042374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:27.042374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:27.042374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:27.042374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:27.042374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:27.042374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:27.042374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:27.042374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:27.042374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:11:27.042374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:11:27.042374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:27.043261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:27.044143 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:11:27.044143 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:11:27.044143 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:11:27.044143 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:11:27.044143 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:11:27.044143 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:11:27.044143 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:27.044143 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:27.044143 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 282/576] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:27.044143 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4205f-c0cc-4212-985a-990b3b839995 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:27.082883 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:27.155671 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4205f-c0cc-4212-985a-990b3b839995 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:27.159038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec796ae-d488-47af-a1fd-0a19499503b8 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:27.192122 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866a7f8-fda3-4637-ae8a-5a4558f7e65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:27.192729 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866a7f8-fda3-4637-ae8a-5a4558f7e65f None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:27.193063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866a7f8-fda3-4637-ae8a-5a4558f7e65f None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:27.193311 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866a7f8-fda3-4637-ae8a-5a4558f7e65f None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:27.193948 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866a7f8-fda3-4637-ae8a-5a4558f7e65f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:27.194272 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866a7f8-fda3-4637-ae8a-5a4558f7e65f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:27.195298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66038de3-0db2-4001-9822-862a6ff50a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:27.195704 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866a7f8-fda3-4637-ae8a-5a4558f7e65f None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:27.195962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66038de3-0db2-4001-9822-862a6ff50a3d None admin] REQUEST_METHOD: `PUT` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:27.196268 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66038de3-0db2-4001-9822-862a6ff50a3d None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:27.196510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66038de3-0db2-4001-9822-862a6ff50a3d None admin] PATH_INFO: `/v3/projects/b38e380f92824682a8286e59af2fc23c/users/0cd2faa457434dc6bfec69ecfa952ed4/roles/c1ad293fe0c443e98339ca975dc18549` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:27.207962 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 283/577] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:27.209950 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866a7f8-fda3-4637-ae8a-5a4558f7e65f None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:27.215510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66038de3-0db2-4001-9822-862a6ff50a3d None admin] RBAC: Authorizing `identity:create_grant(project_id=b38e380f92824682a8286e59af2fc23c, user_id=0cd2faa457434dc6bfec69ecfa952ed4, role_id=c1ad293fe0c443e98339ca975dc18549)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:27.217009 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66038de3-0db2-4001-9822-862a6ff50a3d None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:27.219507 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:27.310652 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:27.317743 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 295/578] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Aug 19 01:11:27 2022] PUT /identity/v3/projects/b38e380f92824682a8286e59af2fc23c/users/0cd2faa457434dc6bfec69ecfa952ed4/roles/c1ad293fe0c443e98339ca975dc18549 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:11:27.318518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866a7f8-fda3-4637-ae8a-5a4558f7e65f None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:27.321312 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66038de3-0db2-4001-9822-862a6ff50a3d None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:27.362536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509d44d-5543-430c-af5d-7c4753d13658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:27.363632 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509d44d-5543-430c-af5d-7c4753d13658 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:27.364117 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509d44d-5543-430c-af5d-7c4753d13658 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:27.364641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509d44d-5543-430c-af5d-7c4753d13658 None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:27.365788 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509d44d-5543-430c-af5d-7c4753d13658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:27.366334 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509d44d-5543-430c-af5d-7c4753d13658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:27.368205 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509d44d-5543-430c-af5d-7c4753d13658 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:27.383931 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 284/579] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:11:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:27.390326 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509d44d-5543-430c-af5d-7c4753d13658 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:27.479087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66038de3-0db2-4001-9822-862a6ff50a3d None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:27.513692 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509d44d-5543-430c-af5d-7c4753d13658 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:27.533886 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7319f-b984-4841-9693-cad216006bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:27.534522 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7319f-b984-4841-9693-cad216006bdf None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:27.534802 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7319f-b984-4841-9693-cad216006bdf None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:27.535074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7319f-b984-4841-9693-cad216006bdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:27.543038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7319f-b984-4841-9693-cad216006bdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:27.544765 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7319f-b984-4841-9693-cad216006bdf None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:27.572281 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-54f7319f-b984-4841-9693-cad216006bdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:27.572281 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:27.572281 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:27.572281 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:27.572281 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:27.572281 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:27.572281 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:27.572281 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:27.572281 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:27.572281 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:27.572281 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:27.572281 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:27.572281 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:11:27.572281 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:11:27.572281 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:27.573960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:27.574839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:11:27.574839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:11:27.574839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:11:27.574839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:11:27.574839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:11:27.574839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:11:27.574839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:27.574839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:27.574839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 296/580] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:27.575319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae2bcb-9f3a-4169-b7ba-3b005824fd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:27.575319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae2bcb-9f3a-4169-b7ba-3b005824fd69 None admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:27.575319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae2bcb-9f3a-4169-b7ba-3b005824fd69 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:27.575319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae2bcb-9f3a-4169-b7ba-3b005824fd69 None admin] PATH_INFO: `/v3/projects/b38e380f92824682a8286e59af2fc23c/users/1d273bdfc2d147ba9392544f9e8831a2/roles/c1ad293fe0c443e98339ca975dc18549` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:27.577892 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7319f-b984-4841-9693-cad216006bdf None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:27.593332 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae2bcb-9f3a-4169-b7ba-3b005824fd69 None admin] RBAC: Authorizing `identity:create_grant(project_id=b38e380f92824682a8286e59af2fc23c, user_id=1d273bdfc2d147ba9392544f9e8831a2, role_id=c1ad293fe0c443e98339ca975dc18549)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:27.595172 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae2bcb-9f3a-4169-b7ba-3b005824fd69 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:27.641341 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:27.691083 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7319f-b984-4841-9693-cad216006bdf None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:27.702263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 285/581] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Aug 19 01:11:27 2022] PUT /identity/v3/projects/b38e380f92824682a8286e59af2fc23c/users/1d273bdfc2d147ba9392544f9e8831a2/roles/c1ad293fe0c443e98339ca975dc18549 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:11:27.738139 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335285b-6022-4a0a-a4c3-fbce7b828fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:27.738861 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335285b-6022-4a0a-a4c3-fbce7b828fac None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:27.739154 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335285b-6022-4a0a-a4c3-fbce7b828fac None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:27.739472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335285b-6022-4a0a-a4c3-fbce7b828fac None admin] PATH_INFO: `/v3/projects` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:27.740191 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335285b-6022-4a0a-a4c3-fbce7b828fac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:27.740539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335285b-6022-4a0a-a4c3-fbce7b828fac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:27.742214 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335285b-6022-4a0a-a4c3-fbce7b828fac None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:27.761888 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 297/582] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:11:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:27.764037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae2bcb-9f3a-4169-b7ba-3b005824fd69 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:27.797655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:27.891836 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae2bcb-9f3a-4169-b7ba-3b005824fd69 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:27.933981 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3551618-0086-4774-8ba1-036fce0ff0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:27.935041 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3551618-0086-4774-8ba1-036fce0ff0d8 None admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:27.935527 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3551618-0086-4774-8ba1-036fce0ff0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:27.936004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3551618-0086-4774-8ba1-036fce0ff0d8 None admin] PATH_INFO: `/v3/projects/b38e380f92824682a8286e59af2fc23c/users/51d3ab73e09b4d94b06df7eaf1d8b85e/roles/c1ad293fe0c443e98339ca975dc18549` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:27.953311 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3551618-0086-4774-8ba1-036fce0ff0d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b38e380f92824682a8286e59af2fc23c, user_id=51d3ab73e09b4d94b06df7eaf1d8b85e, role_id=c1ad293fe0c443e98339ca975dc18549)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:27.955125 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3551618-0086-4774-8ba1-036fce0ff0d8 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:28.009306 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 286/583] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Aug 19 01:11:27 2022] PUT /identity/v3/projects/b38e380f92824682a8286e59af2fc23c/users/51d3ab73e09b4d94b06df7eaf1d8b85e/roles/c1ad293fe0c443e98339ca975dc18549 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:11:28.356207 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1acbc-d055-47e0-b1df-5e713a24e70a None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:28.356703 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1acbc-d055-47e0-b1df-5e713a24e70a None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:28.356804 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1acbc-d055-47e0-b1df-5e713a24e70a None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:28.358381 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 298/584] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:28.363603 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d78a24-9599-4ac6-8d2c-ef85a0edef8d None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:28.363893 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d78a24-9599-4ac6-8d2c-ef85a0edef8d None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:28.364163 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d78a24-9599-4ac6-8d2c-ef85a0edef8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:28.382220 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-a2d78a24-9599-4ac6-8d2c-ef85a0edef8d None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:28.383412 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-a2d78a24-9599-4ac6-8d2c-ef85a0edef8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:28.436179 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:28.458596 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 287/585] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:28.791670 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1acbc-d055-47e0-b1df-5e713a24e70a None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:28.911745 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1acbc-d055-47e0-b1df-5e713a24e70a None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:28.928126 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:28.951010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1efaa-4531-499a-b517-f55615b812b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:28.953119 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1efaa-4531-499a-b517-f55615b812b3 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:28.953119 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1efaa-4531-499a-b517-f55615b812b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:28.953119 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1efaa-4531-499a-b517-f55615b812b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:28.964741 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1efaa-4531-499a-b517-f55615b812b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:28.969798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-1bf1efaa-4531-499a-b517-f55615b812b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:28.969798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:28.969798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:28.969798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:28.969798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:28.969798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:28.969798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:28.969798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:28.969798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:28.969798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:28.969798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:28.969798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:28.969798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:28.969798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:28.969798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:28.969798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:28.970775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:28.970775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:28.970775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:28.970775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:28.970775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:28.970775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:28.970775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:28.970775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:28.970775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:28.970775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:28.970775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:28.970775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:28.970775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:28.970775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:28.970775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:28.970775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:28.971644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:28.971644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:28.971644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:28.971644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:28.971644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:28.971644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:28.971644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:28.971644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:28.971644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:28.971644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:28.971644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:28.971644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:28.974242 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 299/586] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:11:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:28.980976 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d78a24-9599-4ac6-8d2c-ef85a0edef8d None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:29.088031 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d78a24-9599-4ac6-8d2c-ef85a0edef8d None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:29.125036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29a4cb-3eca-4ba4-aad1-6215e103d7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:29.125647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29a4cb-3eca-4ba4-aad1-6215e103d7e6 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:29.125925 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29a4cb-3eca-4ba4-aad1-6215e103d7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:29.126194 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29a4cb-3eca-4ba4-aad1-6215e103d7e6 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:29.126859 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29a4cb-3eca-4ba4-aad1-6215e103d7e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:29.127157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29a4cb-3eca-4ba4-aad1-6215e103d7e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:29.128640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29a4cb-3eca-4ba4-aad1-6215e103d7e6 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:29.138830 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 288/587] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Aug 19 01:11:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:29.144577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1efaa-4531-499a-b517-f55615b812b3 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:29.255000 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1efaa-4531-499a-b517-f55615b812b3 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:29.290021 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63675f1a-9599-4119-bf9d-156b87db560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:29.290658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63675f1a-9599-4119-bf9d-156b87db560a None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:29.290936 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63675f1a-9599-4119-bf9d-156b87db560a None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:29.291207 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63675f1a-9599-4119-bf9d-156b87db560a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:29.304167 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63675f1a-9599-4119-bf9d-156b87db560a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:29.305652 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63675f1a-9599-4119-bf9d-156b87db560a None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:29.320592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-63675f1a-9599-4119-bf9d-156b87db560a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:29.320592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:29.320592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:29.320592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:29.320592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:29.320592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:29.320592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:29.320592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:29.320592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:29.320592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:29.320592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:29.320592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:29.320592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:29.320592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:29.320592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:29.320592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:29.321614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:29.322490 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:29.322490 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:29.322490 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:29.322490 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 300/588] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:29.328661 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29a4cb-3eca-4ba4-aad1-6215e103d7e6 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:29.380706 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:29.437238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29a4cb-3eca-4ba4-aad1-6215e103d7e6 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:29.480493 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d84b68-8b59-4342-8186-c3f4e67d0039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:29.481130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d84b68-8b59-4342-8186-c3f4e67d0039 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:29.481413 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d84b68-8b59-4342-8186-c3f4e67d0039 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:29.481683 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d84b68-8b59-4342-8186-c3f4e67d0039 None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:29.482321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d84b68-8b59-4342-8186-c3f4e67d0039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:29.482626 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d84b68-8b59-4342-8186-c3f4e67d0039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:29.484004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d84b68-8b59-4342-8186-c3f4e67d0039 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:29.497752 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 289/589] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:29.503148 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63675f1a-9599-4119-bf9d-156b87db560a None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:29.534830 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:29.621931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63675f1a-9599-4119-bf9d-156b87db560a None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:29.658370 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7477d-7692-4eb7-ae06-d47dfa44d85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:29.658913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7477d-7692-4eb7-ae06-d47dfa44d85b None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:29.659188 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7477d-7692-4eb7-ae06-d47dfa44d85b None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:29.659511 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7477d-7692-4eb7-ae06-d47dfa44d85b None admin] PATH_INFO: `/v3/users/nova` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:29.667313 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7477d-7692-4eb7-ae06-d47dfa44d85b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:29.668746 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7477d-7692-4eb7-ae06-d47dfa44d85b None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:29.680135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-2fe7477d-7692-4eb7-ae06-d47dfa44d85b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 01:11:29.680135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:29.680135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:29.680135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:29.680135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:29.680135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:29.680135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:29.680135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:29.680135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:29.680135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:29.680135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:29.680135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:29.680135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:11:29.680135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:11:29.680135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:11:29.680135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:29.681137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:29.682085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:29.682085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:29.682085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:11:29.682085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:11:29.682085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:11:29.682085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:11:29.682085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:11:29.682085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:11:29.682085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 01:11:29.682085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:29.682085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 301/590] 10.222.0.82 () {56 vars in 1093 bytes} [Fri Aug 19 01:11:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:29.687965 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d84b68-8b59-4342-8186-c3f4e67d0039 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:29.715955 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33e3c1-7a61-4bd7-8e2d-f3f36f6a76b2 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:29.716382 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33e3c1-7a61-4bd7-8e2d-f3f36f6a76b2 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:29.716671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33e3c1-7a61-4bd7-8e2d-f3f36f6a76b2 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:29.718769 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 302/591] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:29.723690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4a145-129a-4b38-b080-d8d92b794224 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:29.723977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4a145-129a-4b38-b080-d8d92b794224 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:29.724252 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4a145-129a-4b38-b080-d8d92b794224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:29.742785 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-ebe4a145-129a-4b38-b080-d8d92b794224 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:29.743991 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-ebe4a145-129a-4b38-b080-d8d92b794224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:29.813218 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d84b68-8b59-4342-8186-c3f4e67d0039 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:29.825661 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 303/592] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:29.825989 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:29.856302 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98cc98-17d3-43a0-9bb3-b6b996ff61a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:29.857114 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98cc98-17d3-43a0-9bb3-b6b996ff61a5 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:29.857389 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98cc98-17d3-43a0-9bb3-b6b996ff61a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:29.857657 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98cc98-17d3-43a0-9bb3-b6b996ff61a5 None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:29.858387 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98cc98-17d3-43a0-9bb3-b6b996ff61a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:29.858688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98cc98-17d3-43a0-9bb3-b6b996ff61a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:29.860271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98cc98-17d3-43a0-9bb3-b6b996ff61a5 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:29.880928 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 290/593] 10.222.0.82 () {56 vars in 1133 bytes} [Fri Aug 19 01:11:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:29.887362 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4a145-129a-4b38-b080-d8d92b794224 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:29.921436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:29.997159 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8663a90-45d7-415f-a651-cb517e522511 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:29.997159 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8663a90-45d7-415f-a651-cb517e522511 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:29.997159 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8663a90-45d7-415f-a651-cb517e522511 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:29.998238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 291/594] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:11:30.000235 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4a145-129a-4b38-b080-d8d92b794224 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:30.004072 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d68c7-b082-47e9-8edc-e1cccb566b74 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:30.004566 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d68c7-b082-47e9-8edc-e1cccb566b74 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:30.005161 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d68c7-b082-47e9-8edc-e1cccb566b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:30.030526 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-6f1d68c7-b082-47e9-8edc-e1cccb566b74 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:30.032961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-6f1d68c7-b082-47e9-8edc-e1cccb566b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:30.040745 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fed07-efe3-4a30-af23-86a5b39f54c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:30.041504 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fed07-efe3-4a30-af23-86a5b39f54c2 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:30.041978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fed07-efe3-4a30-af23-86a5b39f54c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:30.043060 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fed07-efe3-4a30-af23-86a5b39f54c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:30.118963 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 292/595] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:11:30.132483 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fed07-efe3-4a30-af23-86a5b39f54c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:30.134042 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fed07-efe3-4a30-af23-86a5b39f54c2 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:30.153463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:30.157012 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d68c7-b082-47e9-8edc-e1cccb566b74 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:30.266483 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:30.272768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d68c7-b082-47e9-8edc-e1cccb566b74 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:30.280173 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 304/596] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:11:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:11:30.281333 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fed07-efe3-4a30-af23-86a5b39f54c2 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:30.310113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e32c9-9180-469e-811c-23ee79680564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:30.310746 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e32c9-9180-469e-811c-23ee79680564 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:30.311028 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e32c9-9180-469e-811c-23ee79680564 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:30.311301 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e32c9-9180-469e-811c-23ee79680564 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:30.321802 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e32c9-9180-469e-811c-23ee79680564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:30.328052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-5c7e32c9-9180-469e-811c-23ee79680564 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:30.328052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:30.328052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:30.328052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:30.328052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:30.328052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:30.328052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:30.328052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:30.328052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:30.328052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:30.328052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:30.328052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:30.328052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:30.328052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:30.328052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:30.328052 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:30.329063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:30.329063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:30.329063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:30.329063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:30.329063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:30.329063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:30.329063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:30.329063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:30.329063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:30.329063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:30.329063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:30.329063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:30.329063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:30.329063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:30.329063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:30.329063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:30.329881 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:30.329881 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:30.329881 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:30.329881 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:30.329881 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:30.329881 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:30.329881 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:30.329881 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:30.329881 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:30.329881 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:30.329881 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:30.329881 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:30.334066 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 293/597] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:11:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:11:30.335384 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e32c9-9180-469e-811c-23ee79680564 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:30.388256 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fed07-efe3-4a30-af23-86a5b39f54c2 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:30.406008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:30.424090 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b803f-b87f-4325-a7b8-495f9b1ebb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:30.424716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b803f-b87f-4325-a7b8-495f9b1ebb18 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:30.425133 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b803f-b87f-4325-a7b8-495f9b1ebb18 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:30.425400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b803f-b87f-4325-a7b8-495f9b1ebb18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:30.436097 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b803f-b87f-4325-a7b8-495f9b1ebb18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:30.438078 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b803f-b87f-4325-a7b8-495f9b1ebb18 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:30.447577 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e32c9-9180-469e-811c-23ee79680564 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:30.453612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-7c4b803f-b87f-4325-a7b8-495f9b1ebb18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:30.453612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:30.453612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:30.453612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:30.453612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:30.453612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:30.453612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:30.453612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:30.453612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:30.453612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:30.453612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:30.453612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:30.453612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:30.453612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:30.453612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:30.453612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:30.454690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:30.455748 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:30.455748 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:30.455748 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:30.455748 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 305/598] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:30.456171 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45c93-4e34-43a5-b8c0-f2b402e17492 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:30.456453 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45c93-4e34-43a5-b8c0-f2b402e17492 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:30.456726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45c93-4e34-43a5-b8c0-f2b402e17492 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:30.460964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 306/599] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:30.460964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f45c93-4e34-43a5-b8c0-f2b402e17492 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:30.489970 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574fa1d-1d34-482f-83b9-b48736d0d338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:30.490573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574fa1d-1d34-482f-83b9-b48736d0d338 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:30.490853 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574fa1d-1d34-482f-83b9-b48736d0d338 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:30.491121 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574fa1d-1d34-482f-83b9-b48736d0d338 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:30.491785 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574fa1d-1d34-482f-83b9-b48736d0d338 None admin] RBAC: Adding query filter params (name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:30.492085 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574fa1d-1d34-482f-83b9-b48736d0d338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:30.493515 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574fa1d-1d34-482f-83b9-b48736d0d338 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:30.502130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 294/600] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Aug 19 01:11:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:30.502919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574fa1d-1d34-482f-83b9-b48736d0d338 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:30.522071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:30.571450 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f45c93-4e34-43a5-b8c0-f2b402e17492 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:30.603535 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574fa1d-1d34-482f-83b9-b48736d0d338 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:30.606212 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb88bb7-562b-4df2-8360-4c8bfccf5682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:30.606823 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb88bb7-562b-4df2-8360-4c8bfccf5682 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:30.607101 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb88bb7-562b-4df2-8360-4c8bfccf5682 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:30.607371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb88bb7-562b-4df2-8360-4c8bfccf5682 None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:30.608003 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb88bb7-562b-4df2-8360-4c8bfccf5682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:30.608321 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb88bb7-562b-4df2-8360-4c8bfccf5682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:30.609697 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb88bb7-562b-4df2-8360-4c8bfccf5682 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:30.622108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 307/601] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:30.623105 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d77d35-5cab-4897-a79a-42c377a2011e None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:30.623390 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d77d35-5cab-4897-a79a-42c377a2011e None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:30.623663 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d77d35-5cab-4897-a79a-42c377a2011e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:30.640414 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cb94e-5566-4d4c-96db-b66ea0b67975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:30.640945 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-02d77d35-5cab-4897-a79a-42c377a2011e None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:30.641067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cb94e-5566-4d4c-96db-b66ea0b67975 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:30.641337 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cb94e-5566-4d4c-96db-b66ea0b67975 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:30.641609 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cb94e-5566-4d4c-96db-b66ea0b67975 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:30.642179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-02d77d35-5cab-4897-a79a-42c377a2011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:30.652543 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cb94e-5566-4d4c-96db-b66ea0b67975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:30.657255 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-d00cb94e-5566-4d4c-96db-b66ea0b67975 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:30.657255 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:30.657255 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:30.657255 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:30.657255 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:30.657255 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:30.657255 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:30.657255 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:30.657255 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:30.657255 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:30.657255 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:30.657255 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:30.657255 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:30.657255 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:30.657255 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:30.657255 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:30.658209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:30.658209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:30.658209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:30.658209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:30.658209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:30.658209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:30.658209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:30.658209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:30.658209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:30.658209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:30.658209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:30.658209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:30.658209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:30.658209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:30.658209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:30.658209 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:30.659060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:30.659060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:30.659060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:30.659060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:30.659060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:30.659060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:30.659060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:30.659060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:30.659060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:30.659060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:30.659060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:30.659060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:30.659060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 295/602] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:11:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:30.659829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cb94e-5566-4d4c-96db-b66ea0b67975 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:30.672594 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:30.716220 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 308/603] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:30.717079 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d77d35-5cab-4897-a79a-42c377a2011e None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:30.738936 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:30.763066 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cb94e-5566-4d4c-96db-b66ea0b67975 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:30.801795 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096bcf1-afb7-4858-bd17-6ff39da02957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:30.802740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096bcf1-afb7-4858-bd17-6ff39da02957 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:30.803302 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096bcf1-afb7-4858-bd17-6ff39da02957 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:30.803784 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096bcf1-afb7-4858-bd17-6ff39da02957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:30.815695 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096bcf1-afb7-4858-bd17-6ff39da02957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:30.817732 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096bcf1-afb7-4858-bd17-6ff39da02957 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:30.829821 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d77d35-5cab-4897-a79a-42c377a2011e None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:30.834508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-1096bcf1-afb7-4858-bd17-6ff39da02957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:30.834508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:30.834508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:30.834508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:30.834508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:30.834508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:30.834508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:30.834508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:30.834508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:30.834508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:30.834508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:30.834508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:30.834508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:30.834508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:30.834508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:30.834508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:30.835434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:30.836341 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:30.836341 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:30.836341 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:30.836341 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 296/604] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:30.836341 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096bcf1-afb7-4858-bd17-6ff39da02957 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:30.873919 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363eef0-626a-4fee-abb0-4554c35021e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:30.874879 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363eef0-626a-4fee-abb0-4554c35021e5 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:30.875296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363eef0-626a-4fee-abb0-4554c35021e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:30.875943 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363eef0-626a-4fee-abb0-4554c35021e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:30.883765 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363eef0-626a-4fee-abb0-4554c35021e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:30.886315 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363eef0-626a-4fee-abb0-4554c35021e5 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:30.897299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-b363eef0-626a-4fee-abb0-4554c35021e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:30.897299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:30.897299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:30.897299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:30.897299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:30.897299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:30.897299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:30.897299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:30.897299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:30.897299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:30.897299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:30.897299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:30.897299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:11:30.897299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:11:30.897299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:30.898384 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:30.899495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:11:30.899495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:11:30.899495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:11:30.899495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:11:30.899495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:11:30.899495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:11:30.899495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:30.899495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:30.899495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 309/605] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:30.899495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363eef0-626a-4fee-abb0-4554c35021e5 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:30.920680 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:30.955613 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096bcf1-afb7-4858-bd17-6ff39da02957 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:30.988733 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:30.994193 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641eee80-ed92-40c3-90b7-dfaf3bb5022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:30.994941 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641eee80-ed92-40c3-90b7-dfaf3bb5022d None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:30.995257 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641eee80-ed92-40c3-90b7-dfaf3bb5022d None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:30.995558 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641eee80-ed92-40c3-90b7-dfaf3bb5022d None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:30.996169 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641eee80-ed92-40c3-90b7-dfaf3bb5022d None admin] RBAC: Adding query filter params (name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:30.996473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641eee80-ed92-40c3-90b7-dfaf3bb5022d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:30.997874 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641eee80-ed92-40c3-90b7-dfaf3bb5022d None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:31.011650 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 297/606] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Aug 19 01:11:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:31.012437 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363eef0-626a-4fee-abb0-4554c35021e5 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:31.012611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641eee80-ed92-40c3-90b7-dfaf3bb5022d None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:31.050711 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650adb4c-09e8-4398-aee4-e326dce8f3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:31.051322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650adb4c-09e8-4398-aee4-e326dce8f3fa None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:31.051603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650adb4c-09e8-4398-aee4-e326dce8f3fa None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:31.051926 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650adb4c-09e8-4398-aee4-e326dce8f3fa None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:31.052516 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650adb4c-09e8-4398-aee4-e326dce8f3fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:31.052816 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650adb4c-09e8-4398-aee4-e326dce8f3fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:31.054226 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650adb4c-09e8-4398-aee4-e326dce8f3fa None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:31.065926 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 310/607] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:31.066599 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650adb4c-09e8-4398-aee4-e326dce8f3fa None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:31.118278 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641eee80-ed92-40c3-90b7-dfaf3bb5022d None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:31.145526 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:31.153834 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effa1cc-33ee-49d9-97da-f69f9a5414c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:31.154442 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effa1cc-33ee-49d9-97da-f69f9a5414c9 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:31.154719 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effa1cc-33ee-49d9-97da-f69f9a5414c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:31.154988 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effa1cc-33ee-49d9-97da-f69f9a5414c9 None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:31.155672 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effa1cc-33ee-49d9-97da-f69f9a5414c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:31.157713 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effa1cc-33ee-49d9-97da-f69f9a5414c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:31.157713 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effa1cc-33ee-49d9-97da-f69f9a5414c9 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:31.168939 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650adb4c-09e8-4398-aee4-e326dce8f3fa None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:31.169510 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 298/608] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:11:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:31.170092 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effa1cc-33ee-49d9-97da-f69f9a5414c9 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:31.202849 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5ea02-7d69-48ae-905c-c2f8bf9369f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:31.203471 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5ea02-7d69-48ae-905c-c2f8bf9369f1 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:31.203743 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5ea02-7d69-48ae-905c-c2f8bf9369f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:31.204008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5ea02-7d69-48ae-905c-c2f8bf9369f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:31.214722 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5ea02-7d69-48ae-905c-c2f8bf9369f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:31.216150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5ea02-7d69-48ae-905c-c2f8bf9369f1 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:31.224223 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:31.230267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-4bc5ea02-7d69-48ae-905c-c2f8bf9369f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:31.230267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:31.230267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:31.230267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:31.230267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:31.230267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:31.230267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:31.230267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:31.230267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:31.230267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:31.230267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:31.230267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:31.230267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:31.230267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:31.230267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:31.230267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:31.231266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:31.232140 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:31.232140 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:31.232140 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:31.232140 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 311/609] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:31.232140 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5ea02-7d69-48ae-905c-c2f8bf9369f1 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:31.277509 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effa1cc-33ee-49d9-97da-f69f9a5414c9 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:31.316011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3fc8e-4e76-4566-a817-3f2ece64207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:31.316550 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3fc8e-4e76-4566-a817-3f2ece64207d None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:31.316827 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3fc8e-4e76-4566-a817-3f2ece64207d None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:31.317126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3fc8e-4e76-4566-a817-3f2ece64207d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:31.327866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3fc8e-4e76-4566-a817-3f2ece64207d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:31.331493 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5ea02-7d69-48ae-905c-c2f8bf9369f1 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:31.332974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-4be3fc8e-4e76-4566-a817-3f2ece64207d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:31.332974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:31.332974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:31.332974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:31.332974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:31.332974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:31.332974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:31.332974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:31.332974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:31.332974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:31.332974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:31.332974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:31.332974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:31.332974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:31.332974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:31.332974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:31.334068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:31.334068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:31.334068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:31.334068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:31.334068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:31.334068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:31.334068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:31.334068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:31.334068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:31.334068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:31.334068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:31.334068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:31.334068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:31.334068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:31.334068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:31.334068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:31.334905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:31.334905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:31.334905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:31.334905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:31.334905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:31.334905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:31.334905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:31.334905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:31.334905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:31.334905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:31.334905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:11:31.334905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:31.334905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 299/610] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:11:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:31.334905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3fc8e-4e76-4566-a817-3f2ece64207d None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:31.364085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:31.369669 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ab6f0-8e7c-413a-b3d2-470f9f7eae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:31.370924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ab6f0-8e7c-413a-b3d2-470f9f7eae3e None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:31.371266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ab6f0-8e7c-413a-b3d2-470f9f7eae3e None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:31.371533 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ab6f0-8e7c-413a-b3d2-470f9f7eae3e None admin] PATH_INFO: `/v3/users/glance` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:31.378951 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ab6f0-8e7c-413a-b3d2-470f9f7eae3e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:31.380382 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ab6f0-8e7c-413a-b3d2-470f9f7eae3e None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:31.391587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-453ab6f0-8e7c-413a-b3d2-470f9f7eae3e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 01:11:31.391587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:31.391587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:31.391587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:31.391587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:31.391587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:31.391587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:31.391587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:31.391587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:31.391587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:31.391587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:31.391587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:31.391587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:11:31.391587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:11:31.391587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:11:31.391587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:31.392775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:31.394038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:31.394038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:31.394038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:11:31.394038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:11:31.394038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:11:31.394038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:11:31.394038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:11:31.394038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:11:31.394038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 01:11:31.394038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:31.394038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 312/611] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:11:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:31.394038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ab6f0-8e7c-413a-b3d2-470f9f7eae3e None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:31.437286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3fc8e-4e76-4566-a817-3f2ece64207d None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:31.450753 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:31.471046 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b8aca-434d-4b02-80c4-d5b3d6331402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:31.471636 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b8aca-434d-4b02-80c4-d5b3d6331402 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:31.471921 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b8aca-434d-4b02-80c4-d5b3d6331402 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:31.472190 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b8aca-434d-4b02-80c4-d5b3d6331402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:31.472940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b8aca-434d-4b02-80c4-d5b3d6331402 None admin] RBAC: Adding query filter params (role.id=c1ad293fe0c443e98339ca975dc18549, scope.project.id=b38e380f92824682a8286e59af2fc23c, user.id=ea9fe590dcf441b09f4fe18bf3d8a7ce) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:31.473252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b8aca-434d-4b02-80c4-d5b3d6331402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:31.474703 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b8aca-434d-4b02-80c4-d5b3d6331402 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:31.480455 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 300/612] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:11:31 2022] GET /identity/v3/role_assignments?user.id=ea9fe590dcf441b09f4fe18bf3d8a7ce&scope.project.id=b38e380f92824682a8286e59af2fc23c&role.id=c1ad293fe0c443e98339ca975dc18549 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:31.481549 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b8aca-434d-4b02-80c4-d5b3d6331402 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:31.499947 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ab6f0-8e7c-413a-b3d2-470f9f7eae3e None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:31.545200 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f98416-9c54-4630-b44d-d5613b4eace6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:31.545882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f98416-9c54-4630-b44d-d5613b4eace6 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:31.546103 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f98416-9c54-4630-b44d-d5613b4eace6 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:31.546372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f98416-9c54-4630-b44d-d5613b4eace6 None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:31.549764 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f98416-9c54-4630-b44d-d5613b4eace6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:31.549764 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f98416-9c54-4630-b44d-d5613b4eace6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:31.549764 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f98416-9c54-4630-b44d-d5613b4eace6 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:31.561966 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 313/613] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:31.562841 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f98416-9c54-4630-b44d-d5613b4eace6 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:31.608364 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b8aca-434d-4b02-80c4-d5b3d6331402 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:31.620301 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:31.649508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8473a-4eb9-4f9d-a599-153ae5ab61cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:31.650122 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8473a-4eb9-4f9d-a599-153ae5ab61cb None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:31.650397 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8473a-4eb9-4f9d-a599-153ae5ab61cb None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:31.650664 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8473a-4eb9-4f9d-a599-153ae5ab61cb None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:31.651428 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8473a-4eb9-4f9d-a599-153ae5ab61cb None admin] RBAC: Adding query filter params (name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:31.651890 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8473a-4eb9-4f9d-a599-153ae5ab61cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:31.653319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8473a-4eb9-4f9d-a599-153ae5ab61cb None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:31.662556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 301/614] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Aug 19 01:11:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:31.663458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8473a-4eb9-4f9d-a599-153ae5ab61cb None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:31.686105 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f98416-9c54-4630-b44d-d5613b4eace6 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:31.711450 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:31.724434 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b9f44-eef7-4fd2-af37-cdd89f79f0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:31.725068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b9f44-eef7-4fd2-af37-cdd89f79f0f4 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:31.725343 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b9f44-eef7-4fd2-af37-cdd89f79f0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:31.727454 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b9f44-eef7-4fd2-af37-cdd89f79f0f4 None admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:31.727454 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b9f44-eef7-4fd2-af37-cdd89f79f0f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:31.727454 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b9f44-eef7-4fd2-af37-cdd89f79f0f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:31.728164 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b9f44-eef7-4fd2-af37-cdd89f79f0f4 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:31.752782 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 314/615] 10.222.0.82 () {56 vars in 1137 bytes} [Fri Aug 19 01:11:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:31.753677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b9f44-eef7-4fd2-af37-cdd89f79f0f4 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:31.788244 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8473a-4eb9-4f9d-a599-153ae5ab61cb None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:31.823731 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739308fc-65e5-4dc9-a194-9dc2c19e9789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:31.824354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739308fc-65e5-4dc9-a194-9dc2c19e9789 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:31.824630 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739308fc-65e5-4dc9-a194-9dc2c19e9789 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:31.824931 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739308fc-65e5-4dc9-a194-9dc2c19e9789 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:31.832725 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739308fc-65e5-4dc9-a194-9dc2c19e9789 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:31.834194 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739308fc-65e5-4dc9-a194-9dc2c19e9789 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:31.847556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-739308fc-65e5-4dc9-a194-9dc2c19e9789 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 01:11:31.847556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:31.847556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:31.847556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:31.847556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:31.847556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:31.847556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:31.847556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:31.847556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:31.847556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:31.847556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:31.847556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:31.847556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:11:31.847556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:11:31.847556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:11:31.847556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:31.848574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:31.849554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:31.849554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:31.849554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:11:31.849554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:11:31.849554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:11:31.849554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:11:31.849554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:11:31.849554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:11:31.849554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 01:11:31.849554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:31.849554 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 302/616] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:11:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:31.852725 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739308fc-65e5-4dc9-a194-9dc2c19e9789 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:31.867202 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b9f44-eef7-4fd2-af37-cdd89f79f0f4 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:31.878190 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:31.905542 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035565d-9cd7-4aae-ac72-3f990b98060a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:31.906337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035565d-9cd7-4aae-ac72-3f990b98060a None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:31.906719 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035565d-9cd7-4aae-ac72-3f990b98060a None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:31.907095 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035565d-9cd7-4aae-ac72-3f990b98060a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:31.919066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035565d-9cd7-4aae-ac72-3f990b98060a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:31.920523 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035565d-9cd7-4aae-ac72-3f990b98060a None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:31.935931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-e035565d-9cd7-4aae-ac72-3f990b98060a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:31.935931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:31.935931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:31.935931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:31.935931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:31.935931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:31.935931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:31.935931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:31.935931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:31.935931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:31.935931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:31.935931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:31.935931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:31.935931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:31.935931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:31.935931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:31.936938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:31.938007 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:31.938007 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:31.938007 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:31.941532 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 315/617] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:31.942381 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035565d-9cd7-4aae-ac72-3f990b98060a None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:31.969083 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:31.973753 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739308fc-65e5-4dc9-a194-9dc2c19e9789 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:32.012404 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f370b3c-df54-4e94-a458-b025f82ac747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:32.013156 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f370b3c-df54-4e94-a458-b025f82ac747 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:32.013442 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f370b3c-df54-4e94-a458-b025f82ac747 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:32.013823 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f370b3c-df54-4e94-a458-b025f82ac747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:32.046299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035565d-9cd7-4aae-ac72-3f990b98060a None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:32.080672 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bc046-9d95-480d-bd5b-06134fffa4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:32.081313 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bc046-9d95-480d-bd5b-06134fffa4e3 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:32.081591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bc046-9d95-480d-bd5b-06134fffa4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:32.081874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bc046-9d95-480d-bd5b-06134fffa4e3 None admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:32.082582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bc046-9d95-480d-bd5b-06134fffa4e3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:32.082886 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bc046-9d95-480d-bd5b-06134fffa4e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:32.084322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bc046-9d95-480d-bd5b-06134fffa4e3 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:32.090044 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f370b3c-df54-4e94-a458-b025f82ac747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:32.091685 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f370b3c-df54-4e94-a458-b025f82ac747 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:32.104786 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 316/618] 10.222.0.82 () {56 vars in 1137 bytes} [Fri Aug 19 01:11:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:32.106087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bc046-9d95-480d-bd5b-06134fffa4e3 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:32.125092 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:32.201510 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:32.211654 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 303/619] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:11:32.211654 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f370b3c-df54-4e94-a458-b025f82ac747 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:32.219010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bc046-9d95-480d-bd5b-06134fffa4e3 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:32.256417 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c571b-0714-43f5-9b13-ed44b6c28aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:32.257063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c571b-0714-43f5-9b13-ed44b6c28aae None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:32.257342 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c571b-0714-43f5-9b13-ed44b6c28aae None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:32.257613 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c571b-0714-43f5-9b13-ed44b6c28aae None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:32.258284 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c571b-0714-43f5-9b13-ed44b6c28aae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:32.258583 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c571b-0714-43f5-9b13-ed44b6c28aae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:32.260112 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c571b-0714-43f5-9b13-ed44b6c28aae None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:32.273073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 317/620] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:32.273914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c571b-0714-43f5-9b13-ed44b6c28aae None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:32.327065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f370b3c-df54-4e94-a458-b025f82ac747 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:32.359314 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:32.362799 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52d62b-8b14-450f-8631-b3f30e0c6cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:32.363555 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52d62b-8b14-450f-8631-b3f30e0c6cc1 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:32.363840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52d62b-8b14-450f-8631-b3f30e0c6cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:32.364116 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52d62b-8b14-450f-8631-b3f30e0c6cc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:32.381540 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c571b-0714-43f5-9b13-ed44b6c28aae None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:32.418690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a88d63-3555-4f1a-9e69-e65a92778e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:32.419316 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a88d63-3555-4f1a-9e69-e65a92778e6e None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:32.419578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a88d63-3555-4f1a-9e69-e65a92778e6e None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:32.419848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a88d63-3555-4f1a-9e69-e65a92778e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:32.431488 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a88d63-3555-4f1a-9e69-e65a92778e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:32.432515 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:32.433738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a88d63-3555-4f1a-9e69-e65a92778e6e None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:32.436148 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52d62b-8b14-450f-8631-b3f30e0c6cc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:32.442585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52d62b-8b14-450f-8631-b3f30e0c6cc1 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:32.449733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-87a88d63-3555-4f1a-9e69-e65a92778e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:32.449733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:32.449733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:32.449733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:32.449733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:32.449733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:32.449733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:32.449733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:32.449733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:32.449733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:32.449733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:32.449733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:32.449733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:32.449733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:32.449733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:32.449733 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:32.450860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:32.451951 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:32.451951 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:32.451951 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:32.457812 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 318/621] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:32.459008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a88d63-3555-4f1a-9e69-e65a92778e6e None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:32.539816 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 304/622] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:11:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:11:32.540920 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52d62b-8b14-450f-8631-b3f30e0c6cc1 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:32.575141 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a88d63-3555-4f1a-9e69-e65a92778e6e None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:32.607145 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:32.612913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99992d03-579d-4c9c-a01b-578fb387e881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:32.613721 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99992d03-579d-4c9c-a01b-578fb387e881 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:32.614016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99992d03-579d-4c9c-a01b-578fb387e881 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:32.614365 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99992d03-579d-4c9c-a01b-578fb387e881 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:32.623151 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99992d03-579d-4c9c-a01b-578fb387e881 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:32.624732 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99992d03-579d-4c9c-a01b-578fb387e881 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:32.637463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-99992d03-579d-4c9c-a01b-578fb387e881 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 01:11:32.637463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:32.637463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:32.637463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:32.637463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:32.637463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:32.637463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:32.637463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:32.637463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:32.637463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:32.637463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:32.637463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:32.637463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:11:32.637463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:11:32.637463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:11:32.637463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:32.638620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:32.639815 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:32.639815 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:32.639815 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:11:32.639815 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:11:32.639815 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:11:32.639815 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:11:32.639815 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:11:32.639815 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:11:32.639815 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 01:11:32.639815 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:32.643184 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 319/623] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:11:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:32.643959 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99992d03-579d-4c9c-a01b-578fb387e881 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:32.656149 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:32.660055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52d62b-8b14-450f-8631-b3f30e0c6cc1 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:32.699853 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58008ed5-8c6f-4d20-ab85-0f5728a2557e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:32.700486 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58008ed5-8c6f-4d20-ab85-0f5728a2557e None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:32.700759 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58008ed5-8c6f-4d20-ab85-0f5728a2557e None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:32.701064 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58008ed5-8c6f-4d20-ab85-0f5728a2557e None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:32.701717 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58008ed5-8c6f-4d20-ab85-0f5728a2557e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:32.702015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58008ed5-8c6f-4d20-ab85-0f5728a2557e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:32.703419 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58008ed5-8c6f-4d20-ab85-0f5728a2557e None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:32.720169 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 305/624] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:32.720169 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58008ed5-8c6f-4d20-ab85-0f5728a2557e None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:32.755597 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99992d03-579d-4c9c-a01b-578fb387e881 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:32.792672 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b64f9-fc54-40ef-900f-7f9a27024843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:32.793292 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b64f9-fc54-40ef-900f-7f9a27024843 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:32.793567 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b64f9-fc54-40ef-900f-7f9a27024843 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:32.793835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b64f9-fc54-40ef-900f-7f9a27024843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:32.804108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b64f9-fc54-40ef-900f-7f9a27024843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:32.805572 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b64f9-fc54-40ef-900f-7f9a27024843 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:32.821738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-ff6b64f9-fc54-40ef-900f-7f9a27024843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:32.821738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:32.821738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:32.821738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:32.821738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:32.821738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:32.821738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:32.821738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:32.821738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:32.821738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:32.821738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:32.821738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:32.821738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:32.821738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:32.821738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:32.821738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:32.822713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:32.823801 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:32.823801 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:32.823801 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:32.823801 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 320/625] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:32.824067 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b64f9-fc54-40ef-900f-7f9a27024843 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:32.833702 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58008ed5-8c6f-4d20-ab85-0f5728a2557e None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:32.872529 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14a67d-f6a5-46d3-8ff5-0d21ba601bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:32.873169 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14a67d-f6a5-46d3-8ff5-0d21ba601bea None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:32.873460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14a67d-f6a5-46d3-8ff5-0d21ba601bea None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:32.873711 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14a67d-f6a5-46d3-8ff5-0d21ba601bea None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:32.874444 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14a67d-f6a5-46d3-8ff5-0d21ba601bea None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:32.874750 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14a67d-f6a5-46d3-8ff5-0d21ba601bea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:32.875851 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:32.876186 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14a67d-f6a5-46d3-8ff5-0d21ba601bea None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:32.898527 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 306/626] 10.222.0.82 () {56 vars in 1139 bytes} [Fri Aug 19 01:11:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:32.899301 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14a67d-f6a5-46d3-8ff5-0d21ba601bea None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:32.921520 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:32.938999 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b64f9-fc54-40ef-900f-7f9a27024843 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:32.977103 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a22d7-8bb5-4a13-84e3-1d19c8d936c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:32.977861 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a22d7-8bb5-4a13-84e3-1d19c8d936c5 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:32.978236 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a22d7-8bb5-4a13-84e3-1d19c8d936c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:32.978594 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a22d7-8bb5-4a13-84e3-1d19c8d936c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:32.986270 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a22d7-8bb5-4a13-84e3-1d19c8d936c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:32.987773 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a22d7-8bb5-4a13-84e3-1d19c8d936c5 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:32.999185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-601a22d7-8bb5-4a13-84e3-1d19c8d936c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:32.999185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:32.999185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:32.999185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:32.999185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:32.999185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:32.999185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:32.999185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:32.999185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:32.999185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:32.999185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:32.999185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:32.999185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:11:32.999185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:11:32.999185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:33.000237 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:33.001352 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:11:33.001352 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:11:33.001352 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:11:33.001352 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:11:33.001352 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:11:33.001352 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:11:33.001352 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:33.001352 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:33.005025 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 321/627] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:33.005863 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a22d7-8bb5-4a13-84e3-1d19c8d936c5 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:33.018316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14a67d-f6a5-46d3-8ff5-0d21ba601bea None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:33.056736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589da16-ebb5-400f-afb8-de1c7c8960c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:33.057563 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589da16-ebb5-400f-afb8-de1c7c8960c1 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:33.058338 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589da16-ebb5-400f-afb8-de1c7c8960c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:33.058595 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589da16-ebb5-400f-afb8-de1c7c8960c1 None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:33.059233 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589da16-ebb5-400f-afb8-de1c7c8960c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:33.059534 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589da16-ebb5-400f-afb8-de1c7c8960c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:33.060982 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589da16-ebb5-400f-afb8-de1c7c8960c1 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:33.075142 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 307/628] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:33.080394 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589da16-ebb5-400f-afb8-de1c7c8960c1 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:33.113002 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a22d7-8bb5-4a13-84e3-1d19c8d936c5 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:33.114986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:33.151952 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00731777-bf02-489b-8dc8-30a7cd2cb303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:33.152802 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00731777-bf02-489b-8dc8-30a7cd2cb303 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:33.153261 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00731777-bf02-489b-8dc8-30a7cd2cb303 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:33.153683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00731777-bf02-489b-8dc8-30a7cd2cb303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:33.168282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:33.194352 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589da16-ebb5-400f-afb8-de1c7c8960c1 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:33.225988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00731777-bf02-489b-8dc8-30a7cd2cb303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:33.227934 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00731777-bf02-489b-8dc8-30a7cd2cb303 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:33.231234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832cb1b-063f-4a9b-a799-bef964aae9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:33.231881 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832cb1b-063f-4a9b-a799-bef964aae9c1 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:33.232121 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832cb1b-063f-4a9b-a799-bef964aae9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:33.232389 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832cb1b-063f-4a9b-a799-bef964aae9c1 None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:33.233100 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832cb1b-063f-4a9b-a799-bef964aae9c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:33.233402 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832cb1b-063f-4a9b-a799-bef964aae9c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:33.238798 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832cb1b-063f-4a9b-a799-bef964aae9c1 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:33.255488 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 308/629] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:11:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:33.256226 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832cb1b-063f-4a9b-a799-bef964aae9c1 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:33.347062 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 322/630] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:11:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:11:33.347924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00731777-bf02-489b-8dc8-30a7cd2cb303 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:33.350436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:33.379275 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832cb1b-063f-4a9b-a799-bef964aae9c1 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:33.416592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed720f-12c3-41d3-a424-87945c3a8d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:33.417324 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed720f-12c3-41d3-a424-87945c3a8d90 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:33.417789 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed720f-12c3-41d3-a424-87945c3a8d90 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:33.418065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed720f-12c3-41d3-a424-87945c3a8d90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:33.420992 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:33.426238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed720f-12c3-41d3-a424-87945c3a8d90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:33.427725 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed720f-12c3-41d3-a424-87945c3a8d90 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:33.440106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-85ed720f-12c3-41d3-a424-87945c3a8d90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:33.440106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:33.440106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:33.440106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:33.440106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:33.440106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:33.440106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:33.440106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:33.440106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:33.440106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:33.440106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:33.440106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:33.440106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:11:33.440106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:11:33.440106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:33.442807 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:33.443977 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:11:33.443977 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:11:33.443977 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:11:33.443977 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:11:33.443977 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:11:33.443977 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:11:33.443977 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:33.443977 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:33.443977 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 309/631] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:33.443977 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed720f-12c3-41d3-a424-87945c3a8d90 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:33.469990 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00731777-bf02-489b-8dc8-30a7cd2cb303 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:33.509977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9c7ea-3b19-4643-8b10-f498403866db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:33.511192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9c7ea-3b19-4643-8b10-f498403866db None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:33.511464 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9c7ea-3b19-4643-8b10-f498403866db None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:33.511734 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9c7ea-3b19-4643-8b10-f498403866db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:33.512444 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9c7ea-3b19-4643-8b10-f498403866db None admin] RBAC: Adding query filter params (role.id=c1ad293fe0c443e98339ca975dc18549, scope.project.id=b38e380f92824682a8286e59af2fc23c, user.id=0cd2faa457434dc6bfec69ecfa952ed4) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:33.512746 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9c7ea-3b19-4643-8b10-f498403866db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:33.514214 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9c7ea-3b19-4643-8b10-f498403866db None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:33.519908 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 323/632] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:11:33 2022] GET /identity/v3/role_assignments?user.id=0cd2faa457434dc6bfec69ecfa952ed4&scope.project.id=b38e380f92824682a8286e59af2fc23c&role.id=c1ad293fe0c443e98339ca975dc18549 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:33.520675 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9c7ea-3b19-4643-8b10-f498403866db None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:33.575471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed720f-12c3-41d3-a424-87945c3a8d90 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:33.612918 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:33.627526 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a63a50-ea8b-4be0-9582-f579d1df38dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:33.628443 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a63a50-ea8b-4be0-9582-f579d1df38dd None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:33.629247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a63a50-ea8b-4be0-9582-f579d1df38dd None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:33.629684 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a63a50-ea8b-4be0-9582-f579d1df38dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:33.647472 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a63a50-ea8b-4be0-9582-f579d1df38dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:33.651831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a63a50-ea8b-4be0-9582-f579d1df38dd None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:33.658608 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9c7ea-3b19-4643-8b10-f498403866db None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:33.674995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-a9a63a50-ea8b-4be0-9582-f579d1df38dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:33.674995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:33.674995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:33.674995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:33.674995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:33.674995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:33.674995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:33.674995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:33.674995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:33.674995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:33.674995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:33.674995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:33.674995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:33.674995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:33.674995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:33.674995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:33.676176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:33.677235 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:33.677235 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:33.677235 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:33.678174 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 310/633] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:33.684916 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a63a50-ea8b-4be0-9582-f579d1df38dd None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:33.707323 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f4af3-0eb5-4573-8e3d-f8514fa21346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:33.708365 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f4af3-0eb5-4573-8e3d-f8514fa21346 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:33.708901 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f4af3-0eb5-4573-8e3d-f8514fa21346 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:33.709535 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f4af3-0eb5-4573-8e3d-f8514fa21346 None admin] PATH_INFO: `/v3/projects` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:33.710882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f4af3-0eb5-4573-8e3d-f8514fa21346 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:33.711383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f4af3-0eb5-4573-8e3d-f8514fa21346 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:33.714311 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f4af3-0eb5-4573-8e3d-f8514fa21346 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:33.731044 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 324/634] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:11:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:33.737288 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f4af3-0eb5-4573-8e3d-f8514fa21346 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:33.759387 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:33.827905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a63a50-ea8b-4be0-9582-f579d1df38dd None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:33.861914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f4af3-0eb5-4573-8e3d-f8514fa21346 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:33.864839 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471315a-7246-4b6b-a8a6-62dc9176dcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:33.865484 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471315a-7246-4b6b-a8a6-62dc9176dcd7 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:33.865764 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471315a-7246-4b6b-a8a6-62dc9176dcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:33.866138 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471315a-7246-4b6b-a8a6-62dc9176dcd7 None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:33.866795 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471315a-7246-4b6b-a8a6-62dc9176dcd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:33.867093 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471315a-7246-4b6b-a8a6-62dc9176dcd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:33.868508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471315a-7246-4b6b-a8a6-62dc9176dcd7 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:33.885122 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 311/635] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:33.885122 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85023f-45bc-41ea-9909-2301529fb8db None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:33.885122 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85023f-45bc-41ea-9909-2301529fb8db None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:33.885122 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85023f-45bc-41ea-9909-2301529fb8db None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:33.885122 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 312/636] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:33.888168 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85023f-45bc-41ea-9909-2301529fb8db None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:33.894543 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:33.905374 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323538ce-be0f-4a4a-9916-3ab783afcc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:33.905985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323538ce-be0f-4a4a-9916-3ab783afcc5d None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:33.910412 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323538ce-be0f-4a4a-9916-3ab783afcc5d None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:33.910412 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323538ce-be0f-4a4a-9916-3ab783afcc5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:33.910412 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323538ce-be0f-4a4a-9916-3ab783afcc5d None admin] RBAC: Adding query filter params (role.id=c1ad293fe0c443e98339ca975dc18549, scope.project.id=b38e380f92824682a8286e59af2fc23c, user.id=1d273bdfc2d147ba9392544f9e8831a2) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:33.910412 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323538ce-be0f-4a4a-9916-3ab783afcc5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:33.910412 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323538ce-be0f-4a4a-9916-3ab783afcc5d None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:33.915041 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 325/637] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:11:33 2022] GET /identity/v3/role_assignments?user.id=1d273bdfc2d147ba9392544f9e8831a2&scope.project.id=b38e380f92824682a8286e59af2fc23c&role.id=c1ad293fe0c443e98339ca975dc18549 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:33.916305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93b93a-4306-4144-aaae-788602ac89a8 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:33.916620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93b93a-4306-4144-aaae-788602ac89a8 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:33.917031 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93b93a-4306-4144-aaae-788602ac89a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:33.938613 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-2a93b93a-4306-4144-aaae-788602ac89a8 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:33.939189 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-2a93b93a-4306-4144-aaae-788602ac89a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:34.020029 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 326/638] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:34.041159 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85023f-45bc-41ea-9909-2301529fb8db None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:34.053026 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:34.082012 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37521040-e694-4239-ad62-852587760ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:34.083050 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37521040-e694-4239-ad62-852587760ef7 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:34.083533 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37521040-e694-4239-ad62-852587760ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:34.084007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37521040-e694-4239-ad62-852587760ef7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:34.091845 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37521040-e694-4239-ad62-852587760ef7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:34.093675 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37521040-e694-4239-ad62-852587760ef7 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:34.106957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-37521040-e694-4239-ad62-852587760ef7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:34.106957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:34.106957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:34.106957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:34.106957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:34.106957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:34.106957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:34.106957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:34.106957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:34.106957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:34.106957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:34.106957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:34.106957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:11:34.106957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:11:34.106957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:34.107866 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:34.108789 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:11:34.108789 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:11:34.108789 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:11:34.108789 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:11:34.108789 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:11:34.108789 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:11:34.108789 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:34.108789 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:34.113475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 313/639] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:34.117572 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93b93a-4306-4144-aaae-788602ac89a8 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:34.226807 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93b93a-4306-4144-aaae-788602ac89a8 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:34.249794 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:34.264841 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b627d-a17a-424e-b1e0-33671140a2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:34.265778 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b627d-a17a-424e-b1e0-33671140a2c1 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:34.266277 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b627d-a17a-424e-b1e0-33671140a2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:34.266744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b627d-a17a-424e-b1e0-33671140a2c1 None admin] PATH_INFO: `/v3/projects` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:34.267624 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b627d-a17a-424e-b1e0-33671140a2c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:34.268124 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b627d-a17a-424e-b1e0-33671140a2c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:34.269785 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b627d-a17a-424e-b1e0-33671140a2c1 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:34.287391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 327/640] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:11:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:34.289945 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37521040-e694-4239-ad62-852587760ef7 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:34.359948 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b627d-a17a-424e-b1e0-33671140a2c1 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:34.409799 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37521040-e694-4239-ad62-852587760ef7 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:34.445139 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc23bc2-fd7b-4c3d-95c7-78ceb574c06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:34.445765 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc23bc2-fd7b-4c3d-95c7-78ceb574c06c None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:34.446042 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc23bc2-fd7b-4c3d-95c7-78ceb574c06c None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:34.446306 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc23bc2-fd7b-4c3d-95c7-78ceb574c06c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:34.447021 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc23bc2-fd7b-4c3d-95c7-78ceb574c06c None admin] RBAC: Adding query filter params (role.id=c1ad293fe0c443e98339ca975dc18549, scope.project.id=b38e380f92824682a8286e59af2fc23c, user.id=51d3ab73e09b4d94b06df7eaf1d8b85e) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:34.447321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc23bc2-fd7b-4c3d-95c7-78ceb574c06c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:34.449739 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc23bc2-fd7b-4c3d-95c7-78ceb574c06c None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:34.456890 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 314/641] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:11:34 2022] GET /identity/v3/role_assignments?user.id=51d3ab73e09b4d94b06df7eaf1d8b85e&scope.project.id=b38e380f92824682a8286e59af2fc23c&role.id=c1ad293fe0c443e98339ca975dc18549 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:34.478472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b627d-a17a-424e-b1e0-33671140a2c1 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:34.516548 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fae1e-cf6f-4049-9700-e93f5077f2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:34.517229 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fae1e-cf6f-4049-9700-e93f5077f2df None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:34.517506 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fae1e-cf6f-4049-9700-e93f5077f2df None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:34.517772 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fae1e-cf6f-4049-9700-e93f5077f2df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:34.531460 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fae1e-cf6f-4049-9700-e93f5077f2df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:34.536883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-fd2fae1e-cf6f-4049-9700-e93f5077f2df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:11:34.536883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:34.536883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:34.536883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:34.536883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:34.536883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:34.536883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:34.536883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:34.536883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:34.536883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:34.536883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:34.536883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:34.536883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:34.536883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:34.536883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:34.536883 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:34.537889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:34.537889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:34.537889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:34.537889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:34.537889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:34.537889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:34.537889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:34.537889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:34.537889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:34.537889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:34.537889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:34.537889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:34.537889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:34.537889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:34.537889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:34.537889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:34.538779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:34.538779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:34.538779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:34.538779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:34.538779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:34.538779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:34.538779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:34.538779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:34.538779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:34.538779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:34.538779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:11:34.538779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:34.538779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 328/642] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:11:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:11:34.546291 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc23bc2-fd7b-4c3d-95c7-78ceb574c06c None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:34.585291 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:34.663716 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc23bc2-fd7b-4c3d-95c7-78ceb574c06c None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:34.699379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649efde-556c-4c40-beae-3b5ae13cfc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:34.700128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649efde-556c-4c40-beae-3b5ae13cfc0d None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:34.700522 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649efde-556c-4c40-beae-3b5ae13cfc0d None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:34.700938 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649efde-556c-4c40-beae-3b5ae13cfc0d None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:34.701719 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649efde-556c-4c40-beae-3b5ae13cfc0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:34.702025 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649efde-556c-4c40-beae-3b5ae13cfc0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:34.703386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649efde-556c-4c40-beae-3b5ae13cfc0d None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:34.713084 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 315/643] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:11:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:34.719332 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fae1e-cf6f-4049-9700-e93f5077f2df None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:34.767249 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:34.834692 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fae1e-cf6f-4049-9700-e93f5077f2df None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:34.872739 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39962534-aeb3-4c55-b3a5-7beb43139ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:34.873398 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39962534-aeb3-4c55-b3a5-7beb43139ef6 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:34.873674 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39962534-aeb3-4c55-b3a5-7beb43139ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:34.873943 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39962534-aeb3-4c55-b3a5-7beb43139ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:34.885077 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39962534-aeb3-4c55-b3a5-7beb43139ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:34.888074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39962534-aeb3-4c55-b3a5-7beb43139ef6 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:34.903192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-39962534-aeb3-4c55-b3a5-7beb43139ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:34.903192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:34.903192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:34.903192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:34.903192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:34.903192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:34.903192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:34.903192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:34.903192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:34.903192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:34.903192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:34.903192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:34.903192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:34.903192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:34.903192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:34.903192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:34.904421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:34.905600 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:34.905600 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:34.905600 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:34.911678 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 329/644] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:34.925026 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649efde-556c-4c40-beae-3b5ae13cfc0d None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:35.014049 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:35.021021 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649efde-556c-4c40-beae-3b5ae13cfc0d None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:35.059769 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e057055-73c7-4efa-9000-23f49785e447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:35.060319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e057055-73c7-4efa-9000-23f49785e447 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:35.060603 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e057055-73c7-4efa-9000-23f49785e447 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:35.060877 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e057055-73c7-4efa-9000-23f49785e447 None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:35.061531 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e057055-73c7-4efa-9000-23f49785e447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:35.061834 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e057055-73c7-4efa-9000-23f49785e447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:35.063228 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e057055-73c7-4efa-9000-23f49785e447 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:35.080055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 316/645] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:35.081414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39962534-aeb3-4c55-b3a5-7beb43139ef6 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:35.181116 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:35.190212 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39962534-aeb3-4c55-b3a5-7beb43139ef6 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:35.225308 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3794a5-00ae-4c77-aa00-eb9c77105ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:35.226396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3794a5-00ae-4c77-aa00-eb9c77105ae9 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:35.227022 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3794a5-00ae-4c77-aa00-eb9c77105ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:35.227499 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3794a5-00ae-4c77-aa00-eb9c77105ae9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:35.236019 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3794a5-00ae-4c77-aa00-eb9c77105ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:35.237747 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3794a5-00ae-4c77-aa00-eb9c77105ae9 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:35.249591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-bd3794a5-00ae-4c77-aa00-eb9c77105ae9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 01:11:35.249591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:35.249591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:35.249591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:35.249591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:35.249591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:35.249591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:35.249591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:35.249591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:35.249591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:35.249591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:35.249591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:35.249591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:11:35.249591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:11:35.249591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:11:35.249591 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:35.250577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:35.251525 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:35.251525 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:35.251525 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:11:35.251525 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:11:35.251525 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:11:35.251525 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:11:35.251525 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:11:35.251525 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:11:35.251525 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 01:11:35.251525 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:35.254151 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 330/646] 10.222.0.82 () {56 vars in 1093 bytes} [Fri Aug 19 01:11:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:35.264883 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e057055-73c7-4efa-9000-23f49785e447 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:35.369289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e057055-73c7-4efa-9000-23f49785e447 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:35.404187 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0435ef-d2d7-4e76-952e-bed3478b1cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:35.404789 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0435ef-d2d7-4e76-952e-bed3478b1cfb None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:35.405093 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0435ef-d2d7-4e76-952e-bed3478b1cfb None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:35.405361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0435ef-d2d7-4e76-952e-bed3478b1cfb None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:35.406082 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0435ef-d2d7-4e76-952e-bed3478b1cfb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:35.406383 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0435ef-d2d7-4e76-952e-bed3478b1cfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:35.407815 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0435ef-d2d7-4e76-952e-bed3478b1cfb None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:35.430478 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 317/647] 10.222.0.82 () {56 vars in 1133 bytes} [Fri Aug 19 01:11:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:35.432323 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3794a5-00ae-4c77-aa00-eb9c77105ae9 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:35.543576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3794a5-00ae-4c77-aa00-eb9c77105ae9 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:35.580624 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bd66f-6ff4-467e-8349-7c808b03f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:35.581403 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bd66f-6ff4-467e-8349-7c808b03f1ae None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:35.581785 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bd66f-6ff4-467e-8349-7c808b03f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:35.582158 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bd66f-6ff4-467e-8349-7c808b03f1ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:35.605544 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:35.655479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bd66f-6ff4-467e-8349-7c808b03f1ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:35.657126 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bd66f-6ff4-467e-8349-7c808b03f1ae None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:35.762827 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 331/648] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:11:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 01:11:35.769137 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0435ef-d2d7-4e76-952e-bed3478b1cfb None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:35.827919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:35.883659 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0435ef-d2d7-4e76-952e-bed3478b1cfb None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:35.929062 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ba8e4-4f50-4ef7-9f7f-5cc8bdda61d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:35.929994 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba8e4-4f50-4ef7-9f7f-5cc8bdda61d7 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:35.930412 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba8e4-4f50-4ef7-9f7f-5cc8bdda61d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:35.930821 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba8e4-4f50-4ef7-9f7f-5cc8bdda61d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:35.942412 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ba8e4-4f50-4ef7-9f7f-5cc8bdda61d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:35.944121 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ba8e4-4f50-4ef7-9f7f-5cc8bdda61d7 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:35.963263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-fd1ba8e4-4f50-4ef7-9f7f-5cc8bdda61d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:35.963263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:35.963263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:35.963263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:35.963263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:35.963263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:35.963263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:35.963263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:35.963263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:35.963263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:35.963263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:35.963263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:35.963263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:35.963263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:35.963263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:35.963263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:35.965029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:35.965930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:35.965930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:35.965930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:35.970841 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133528e-8c4b-41df-bbb8-e899a3f0da5b None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:35.970841 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133528e-8c4b-41df-bbb8-e899a3f0da5b None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:35.970841 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133528e-8c4b-41df-bbb8-e899a3f0da5b None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:35.970841 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 332/650] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:11:35.971386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 318/650] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:35.973866 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133528e-8c4b-41df-bbb8-e899a3f0da5b None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:35.975658 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa940b49-a97c-4234-8d70-2aa37c0589a6 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:35.975937 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa940b49-a97c-4234-8d70-2aa37c0589a6 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:35.976206 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa940b49-a97c-4234-8d70-2aa37c0589a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:35.994310 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-aa940b49-a97c-4234-8d70-2aa37c0589a6 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:35.995767 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-aa940b49-a97c-4234-8d70-2aa37c0589a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:36.045016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:36.074322 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 319/651] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:11:36.074322 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:36.110901 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133528e-8c4b-41df-bbb8-e899a3f0da5b None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:36.146497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4eb8e-199f-4b1a-9c1f-f45938556eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:36.147701 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4eb8e-199f-4b1a-9c1f-f45938556eed None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:36.148203 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4eb8e-199f-4b1a-9c1f-f45938556eed None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:36.148665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4eb8e-199f-4b1a-9c1f-f45938556eed None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:36.149507 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4eb8e-199f-4b1a-9c1f-f45938556eed None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:36.150001 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4eb8e-199f-4b1a-9c1f-f45938556eed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:36.152229 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4eb8e-199f-4b1a-9c1f-f45938556eed None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:36.164266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 333/652] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:36.170622 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa940b49-a97c-4234-8d70-2aa37c0589a6 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:36.250689 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc22de-abf4-452b-9a10-fb354cbbae9e None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:36.250938 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc22de-abf4-452b-9a10-fb354cbbae9e None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:36.251323 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc22de-abf4-452b-9a10-fb354cbbae9e None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:36.252911 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 334/653] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:11:36.260339 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1beb48-5596-41e9-85aa-e1318652d7be None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:36.260339 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1beb48-5596-41e9-85aa-e1318652d7be None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:36.260339 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1beb48-5596-41e9-85aa-e1318652d7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:36.283580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa940b49-a97c-4234-8d70-2aa37c0589a6 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:36.287002 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-3a1beb48-5596-41e9-85aa-e1318652d7be None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:36.288379 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-3a1beb48-5596-41e9-85aa-e1318652d7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:36.319871 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef54dfa-7600-4f4f-9607-ca9c6dabc406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:36.320523 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef54dfa-7600-4f4f-9607-ca9c6dabc406 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:36.320801 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef54dfa-7600-4f4f-9607-ca9c6dabc406 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:36.321140 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef54dfa-7600-4f4f-9607-ca9c6dabc406 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:36.329883 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef54dfa-7600-4f4f-9607-ca9c6dabc406 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:36.331405 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef54dfa-7600-4f4f-9607-ca9c6dabc406 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:36.343872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-4ef54dfa-7600-4f4f-9607-ca9c6dabc406 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:36.343872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:36.343872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:36.343872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:36.343872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:36.343872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:36.343872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:36.343872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:36.343872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:36.343872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:36.343872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:36.343872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:36.343872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:11:36.343872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:11:36.343872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:36.344775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:36.345672 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:11:36.345672 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:11:36.345672 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:11:36.345672 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:11:36.345672 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:11:36.345672 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:11:36.345672 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:36.345672 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:36.349759 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 320/654] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:36.350934 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef54dfa-7600-4f4f-9607-ca9c6dabc406 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:36.373012 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 335/655] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:36.417556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:36.428181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1beb48-5596-41e9-85aa-e1318652d7be None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:36.466058 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef54dfa-7600-4f4f-9607-ca9c6dabc406 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:36.486114 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:36.510513 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8d135-318d-4650-876d-c044d1a8469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:36.511361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8d135-318d-4650-876d-c044d1a8469f None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:36.511361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8d135-318d-4650-876d-c044d1a8469f None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:36.511655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8d135-318d-4650-876d-c044d1a8469f None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:36.512515 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8d135-318d-4650-876d-c044d1a8469f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:36.512823 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8d135-318d-4650-876d-c044d1a8469f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:36.514313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8d135-318d-4650-876d-c044d1a8469f None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:36.534157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 321/656] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:11:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:36.535853 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8d135-318d-4650-876d-c044d1a8469f None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:36.562517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1beb48-5596-41e9-85aa-e1318652d7be None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:36.611965 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29e0e1-9c0f-460e-a574-90624e9b7f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:36.614977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29e0e1-9c0f-460e-a574-90624e9b7f79 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:36.615259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29e0e1-9c0f-460e-a574-90624e9b7f79 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:36.615534 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29e0e1-9c0f-460e-a574-90624e9b7f79 None admin] PATH_INFO: `/v3/services/image` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:36.616129 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29e0e1-9c0f-460e-a574-90624e9b7f79 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:36.617761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29e0e1-9c0f-460e-a574-90624e9b7f79 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-0e29e0e1-9c0f-460e-a574-90624e9b7f79 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:36.630371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:36.631846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:36.631846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:36.631846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:36.631846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:36.631846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:36.631846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:36.631846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:11:36.631846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:11:36.631846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:11:36.631846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:11:36.631846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:36.631846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:36.631846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:36.631846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:36.631846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:36.631846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:36.632964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:36.632964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:36.632964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:36.632964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:36.632964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:36.632964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:36.632964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:36.632964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:36.632964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:36.632964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:36.632964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:11:36.632964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:36.632964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 01:11:36.632964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:36.632964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 336/657] 10.222.0.82 () {56 vars in 1105 bytes} [Fri Aug 19 01:11:36 2022] GET /identity/v3/services/image => generated 86 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:36.637284 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29e0e1-9c0f-460e-a574-90624e9b7f79 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:36.668746 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8d135-318d-4650-876d-c044d1a8469f None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:36.684015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:36.704297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dbc20-58eb-4938-96cb-c2415b01309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:36.705264 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dbc20-58eb-4938-96cb-c2415b01309d None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:36.705533 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dbc20-58eb-4938-96cb-c2415b01309d None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:36.705906 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dbc20-58eb-4938-96cb-c2415b01309d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:36.706630 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dbc20-58eb-4938-96cb-c2415b01309d None admin] RBAC: Adding query filter params (role.id=fda5389edef24d6baac46d87242d285b, scope.project.id=b38e380f92824682a8286e59af2fc23c, user.id=ea9fe590dcf441b09f4fe18bf3d8a7ce) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:36.706934 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dbc20-58eb-4938-96cb-c2415b01309d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:36.708563 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dbc20-58eb-4938-96cb-c2415b01309d None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:36.717442 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 322/658] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:11:36 2022] GET /identity/v3/role_assignments?user.id=ea9fe590dcf441b09f4fe18bf3d8a7ce&scope.project.id=b38e380f92824682a8286e59af2fc23c&role.id=fda5389edef24d6baac46d87242d285b => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:36.717930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dbc20-58eb-4938-96cb-c2415b01309d None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:36.758218 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29e0e1-9c0f-460e-a574-90624e9b7f79 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:36.767612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:36.799654 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a39907-47ad-4a25-8189-60ef21997554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:36.800266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a39907-47ad-4a25-8189-60ef21997554 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:36.800544 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a39907-47ad-4a25-8189-60ef21997554 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:36.800807 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a39907-47ad-4a25-8189-60ef21997554 None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:36.801617 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a39907-47ad-4a25-8189-60ef21997554 None admin] RBAC: Adding query filter params (name=image) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:36.801917 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a39907-47ad-4a25-8189-60ef21997554 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:36.803419 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a39907-47ad-4a25-8189-60ef21997554 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:36.813876 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 337/659] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:36.815046 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a39907-47ad-4a25-8189-60ef21997554 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:36.882068 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dbc20-58eb-4938-96cb-c2415b01309d None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:36.926296 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe0d15-d6ad-4117-a3d3-784d6fb3e678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:36.926964 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe0d15-d6ad-4117-a3d3-784d6fb3e678 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:36.927248 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe0d15-d6ad-4117-a3d3-784d6fb3e678 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:36.927522 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe0d15-d6ad-4117-a3d3-784d6fb3e678 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:36.928110 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe0d15-d6ad-4117-a3d3-784d6fb3e678 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:36.929536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe0d15-d6ad-4117-a3d3-784d6fb3e678 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:36.936691 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a39907-47ad-4a25-8189-60ef21997554 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-2bbe0d15-d6ad-4117-a3d3-784d6fb3e678 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:36.940870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:36.941867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:36.941867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:36.941867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:36.941867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:36.941867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:36.941867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:36.941867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:11:36.941867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:11:36.941867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:11:36.941867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:11:36.941867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:36.941867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:36.941867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:36.941867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:36.941867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:36.941867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:36.942705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:36.942705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:36.942705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:36.942705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:36.942705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:36.942705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:36.942705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:36.942705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:36.942705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:36.942705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:36.942705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:11:36.942705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:36.942705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 01:11:36.942705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:36.942705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 323/660] 10.222.0.82 () {56 vars in 1129 bytes} [Fri Aug 19 01:11:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:36.943480 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a12d3c-fbd4-4dfd-8cc6-0cd85f40a79a None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:36.943480 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a12d3c-fbd4-4dfd-8cc6-0cd85f40a79a None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:36.943987 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a12d3c-fbd4-4dfd-8cc6-0cd85f40a79a None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:36.945260 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 324/661] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:36.947606 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a12d3c-fbd4-4dfd-8cc6-0cd85f40a79a None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:36.979995 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9185e-6736-44da-879a-8901d673115e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:36.980610 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9185e-6736-44da-879a-8901d673115e None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:36.980917 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9185e-6736-44da-879a-8901d673115e None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:36.981198 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9185e-6736-44da-879a-8901d673115e None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:36.981828 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9185e-6736-44da-879a-8901d673115e None admin] RBAC: Adding query filter params (type=image) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:36.982133 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9185e-6736-44da-879a-8901d673115e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:36.983510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9185e-6736-44da-879a-8901d673115e None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:36.989523 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 338/662] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:36.990724 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417a0a9-de30-4d5e-a5d9-b2a509e33106 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:36.991011 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417a0a9-de30-4d5e-a5d9-b2a509e33106 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:36.991291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417a0a9-de30-4d5e-a5d9-b2a509e33106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:37.006095 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:37.013319 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-9417a0a9-de30-4d5e-a5d9-b2a509e33106 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:37.014586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-9417a0a9-de30-4d5e-a5d9-b2a509e33106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:37.049313 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:37.083476 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a12d3c-fbd4-4dfd-8cc6-0cd85f40a79a None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:37.104882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 339/663] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:37.137668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a0658-a277-4e72-8083-f2e22ac00d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:37.138293 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a0658-a277-4e72-8083-f2e22ac00d13 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:37.138574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a0658-a277-4e72-8083-f2e22ac00d13 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:37.138845 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a0658-a277-4e72-8083-f2e22ac00d13 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:37.139489 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a0658-a277-4e72-8083-f2e22ac00d13 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:37.139791 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a0658-a277-4e72-8083-f2e22ac00d13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:37.141231 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a0658-a277-4e72-8083-f2e22ac00d13 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:37.146748 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 325/664] 10.222.0.82 () {56 vars in 1124 bytes} [Fri Aug 19 01:11:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:37.153360 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417a0a9-de30-4d5e-a5d9-b2a509e33106 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:37.269013 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417a0a9-de30-4d5e-a5d9-b2a509e33106 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:37.309649 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f298170-02cb-4bf3-93cc-b49351325a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:37.310178 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f298170-02cb-4bf3-93cc-b49351325a79 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:37.310451 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f298170-02cb-4bf3-93cc-b49351325a79 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:37.310716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f298170-02cb-4bf3-93cc-b49351325a79 None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:37.311342 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f298170-02cb-4bf3-93cc-b49351325a79 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:37.311640 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f298170-02cb-4bf3-93cc-b49351325a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:37.313027 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f298170-02cb-4bf3-93cc-b49351325a79 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:37.317946 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 340/665] 10.222.0.82 () {56 vars in 1124 bytes} [Fri Aug 19 01:11:37 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:37.445853 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a0658-a277-4e72-8083-f2e22ac00d13 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:37.559732 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a0658-a277-4e72-8083-f2e22ac00d13 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:37.574442 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:37.602500 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed7a29-a64c-45bc-8652-fc843dbda239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:37.603191 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed7a29-a64c-45bc-8652-fc843dbda239 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:37.603468 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed7a29-a64c-45bc-8652-fc843dbda239 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:37.603737 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed7a29-a64c-45bc-8652-fc843dbda239 None admin] PATH_INFO: `/v3/services/network` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:37.605210 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed7a29-a64c-45bc-8652-fc843dbda239 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:37.606341 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed7a29-a64c-45bc-8652-fc843dbda239 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-78ed7a29-a64c-45bc-8652-fc843dbda239 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:37.615410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:37.616434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:37.616434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:37.616434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:37.616434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:37.616434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:37.616434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:37.616434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:11:37.616434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:11:37.616434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:11:37.616434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:11:37.616434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:37.616434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:37.616434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:37.616434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:37.616434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:37.616434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:37.617860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:37.617860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:37.617860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:37.617860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:37.617860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:37.617860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:37.617860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:37.617860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:37.617860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:37.617860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:37.617860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:11:37.617860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:37.617860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 01:11:37.617860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:37.617860 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 326/666] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:37 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:37.623432 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f298170-02cb-4bf3-93cc-b49351325a79 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:37.653484 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:37.738775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f298170-02cb-4bf3-93cc-b49351325a79 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:37.776997 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc250b-126a-4552-b4b2-f3455369eea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:37.777762 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc250b-126a-4552-b4b2-f3455369eea3 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:37.777946 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc250b-126a-4552-b4b2-f3455369eea3 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:37.778192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc250b-126a-4552-b4b2-f3455369eea3 None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:37.778826 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc250b-126a-4552-b4b2-f3455369eea3 None admin] RBAC: Adding query filter params (name=network) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:37.779128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc250b-126a-4552-b4b2-f3455369eea3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:37.780508 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc250b-126a-4552-b4b2-f3455369eea3 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:37.785541 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 341/667] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Aug 19 01:11:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:37.791142 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed7a29-a64c-45bc-8652-fc843dbda239 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:37.911260 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed7a29-a64c-45bc-8652-fc843dbda239 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:37.949056 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6b4a6-f78e-4bd7-835f-ce808f98cafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:37.949557 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6b4a6-f78e-4bd7-835f-ce808f98cafa None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:37.949837 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6b4a6-f78e-4bd7-835f-ce808f98cafa None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:37.950109 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6b4a6-f78e-4bd7-835f-ce808f98cafa None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:37.950737 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6b4a6-f78e-4bd7-835f-ce808f98cafa None admin] RBAC: Adding query filter params (type=network) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:37.951093 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6b4a6-f78e-4bd7-835f-ce808f98cafa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:37.952559 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6b4a6-f78e-4bd7-835f-ce808f98cafa None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:37.958713 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 327/668] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Aug 19 01:11:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:39.070731 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6efc4-b6ac-4dfd-8882-91a1de09cd0e None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:39.071782 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6efc4-b6ac-4dfd-8882-91a1de09cd0e None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:39.072338 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6efc4-b6ac-4dfd-8882-91a1de09cd0e None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:39.075896 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 342/669] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:39.082013 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dfc5a-2f01-4210-8828-7f0cca78266b None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:39.082946 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dfc5a-2f01-4210-8828-7f0cca78266b None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:39.083452 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dfc5a-2f01-4210-8828-7f0cca78266b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:39.103820 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-f28dfc5a-2f01-4210-8828-7f0cca78266b None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:39.106234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-f28dfc5a-2f01-4210-8828-7f0cca78266b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:39.140399 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:39.191093 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 328/670] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:39.298392 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de76696-c931-488f-8b2a-b338baeb83f1 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:39.298677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de76696-c931-488f-8b2a-b338baeb83f1 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:39.298960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de76696-c931-488f-8b2a-b338baeb83f1 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:39.300509 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 343/671] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:39.305628 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679721d3-594e-4339-8059-b2acc8accd3f None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:39.306238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679721d3-594e-4339-8059-b2acc8accd3f None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:39.306736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679721d3-594e-4339-8059-b2acc8accd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:39.325722 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-679721d3-594e-4339-8059-b2acc8accd3f None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:39.327356 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-679721d3-594e-4339-8059-b2acc8accd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:39.405890 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 329/672] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:39.532296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de76696-c931-488f-8b2a-b338baeb83f1 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:39.641762 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:39.651117 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cead95-8739-4875-8d05-fb58185f3e79 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:39.651486 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cead95-8739-4875-8d05-fb58185f3e79 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:39.651782 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cead95-8739-4875-8d05-fb58185f3e79 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:39.651962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de76696-c931-488f-8b2a-b338baeb83f1 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:39.653454 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 330/673] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:39.658469 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc391e87-0295-436a-82d6-6cff8db6c2bf None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:39.658813 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc391e87-0295-436a-82d6-6cff8db6c2bf None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:39.659096 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc391e87-0295-436a-82d6-6cff8db6c2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:39.677891 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-cc391e87-0295-436a-82d6-6cff8db6c2bf None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:39.679088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-cc391e87-0295-436a-82d6-6cff8db6c2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:39.689859 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0e657-7558-4048-ad54-01b43a67f93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:39.690734 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0e657-7558-4048-ad54-01b43a67f93b None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:39.691164 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0e657-7558-4048-ad54-01b43a67f93b None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:39.691588 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0e657-7558-4048-ad54-01b43a67f93b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:39.707230 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0e657-7558-4048-ad54-01b43a67f93b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:39.714358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-83e0e657-7558-4048-ad54-01b43a67f93b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:11:39.714358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:39.714358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:39.714358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:39.714358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:39.714358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:39.714358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:39.714358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:39.714358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:39.714358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:39.714358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:39.714358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:39.714358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:39.714358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:39.714358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:39.714358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:39.715300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:39.715300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:39.715300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:39.715300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:39.715300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:39.715300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:39.715300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:39.715300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:39.715300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:39.715300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:39.715300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:39.715300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:39.715300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:39.715300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:39.715300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:39.715300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:39.716400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:39.716400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:39.716400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:39.716400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:39.716400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:39.716400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:39.716400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:39.716400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:39.716400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:39.716400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:39.716400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:11:39.716400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:39.716400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 344/674] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:11:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:39.722948 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0e657-7558-4048-ad54-01b43a67f93b None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:39.764967 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 331/675] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 01:11:39.785603 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc391e87-0295-436a-82d6-6cff8db6c2bf None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:39.816523 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:39.834613 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0e657-7558-4048-ad54-01b43a67f93b None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:39.876777 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08ad22-5eb1-480d-8851-e3ed391af799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:39.877533 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08ad22-5eb1-480d-8851-e3ed391af799 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:39.877821 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08ad22-5eb1-480d-8851-e3ed391af799 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:39.878096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08ad22-5eb1-480d-8851-e3ed391af799 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:39.878931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08ad22-5eb1-480d-8851-e3ed391af799 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:39.879253 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08ad22-5eb1-480d-8851-e3ed391af799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:39.880636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08ad22-5eb1-480d-8851-e3ed391af799 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:39.890811 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 345/676] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:11:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:39.896441 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08ad22-5eb1-480d-8851-e3ed391af799 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:39.917725 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc391e87-0295-436a-82d6-6cff8db6c2bf None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:39.919979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:39.959326 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494307e9-417c-499a-b2c1-c32b84f9049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:39.960361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494307e9-417c-499a-b2c1-c32b84f9049e None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:39.960841 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494307e9-417c-499a-b2c1-c32b84f9049e None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:39.961401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494307e9-417c-499a-b2c1-c32b84f9049e None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:39.962271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494307e9-417c-499a-b2c1-c32b84f9049e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:39.965107 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494307e9-417c-499a-b2c1-c32b84f9049e None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:40.025463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08ad22-5eb1-480d-8851-e3ed391af799 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:40.060368 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4180e-f18b-4696-86ef-5ad859f18969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:40.061032 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4180e-f18b-4696-86ef-5ad859f18969 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:40.061309 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4180e-f18b-4696-86ef-5ad859f18969 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:40.061577 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4180e-f18b-4696-86ef-5ad859f18969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:40.070468 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 332/677] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Aug 19 01:11:39 2022] POST /identity/v3/services => generated 242 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:11:40.074162 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4180e-f18b-4696-86ef-5ad859f18969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:40.075274 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4180e-f18b-4696-86ef-5ad859f18969 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:40.096612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-e6c4180e-f18b-4696-86ef-5ad859f18969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:40.096612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:40.096612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:40.096612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:40.096612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:40.096612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:40.096612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:40.096612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:40.096612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:40.096612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:40.096612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:40.096612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:40.096612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:40.096612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:40.096612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:40.096612 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:40.097712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:40.098611 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:40.098611 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:40.098611 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:40.105151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494307e9-417c-499a-b2c1-c32b84f9049e None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:40.105695 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 346/678] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:11:40.110086 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4180e-f18b-4696-86ef-5ad859f18969 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:40.209382 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:40.219132 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:40.245544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494307e9-417c-499a-b2c1-c32b84f9049e None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:40.264756 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4180e-f18b-4696-86ef-5ad859f18969 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:40.285473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a237e-a2ed-44ef-8a5f-6155bdf9165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:40.286095 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a237e-a2ed-44ef-8a5f-6155bdf9165e None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:40.286377 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a237e-a2ed-44ef-8a5f-6155bdf9165e None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:40.286648 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a237e-a2ed-44ef-8a5f-6155bdf9165e None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:40.287292 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a237e-a2ed-44ef-8a5f-6155bdf9165e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:40.288679 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a237e-a2ed-44ef-8a5f-6155bdf9165e None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:40.306007 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816e323-b545-43fa-9e7a-8f99463c1b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:40.306868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816e323-b545-43fa-9e7a-8f99463c1b46 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:40.307660 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816e323-b545-43fa-9e7a-8f99463c1b46 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:40.307994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816e323-b545-43fa-9e7a-8f99463c1b46 None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:40.308641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816e323-b545-43fa-9e7a-8f99463c1b46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:40.309058 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816e323-b545-43fa-9e7a-8f99463c1b46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:40.310420 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816e323-b545-43fa-9e7a-8f99463c1b46 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:40.322308 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 347/679] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:40.324198 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c23a6-bd93-45ef-98f3-12a21694dc31 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:40.324546 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c23a6-bd93-45ef-98f3-12a21694dc31 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:40.324816 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c23a6-bd93-45ef-98f3-12a21694dc31 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:40.326788 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 348/680] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:40.328976 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c23a6-bd93-45ef-98f3-12a21694dc31 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:40.375788 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 333/681] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Aug 19 01:11:40 2022] POST /identity/v3/services => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:11:40.382606 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a4699-88e5-44d6-a590-00c5365c930d None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:40.383058 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a4699-88e5-44d6-a590-00c5365c930d None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:40.383371 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a4699-88e5-44d6-a590-00c5365c930d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:40.407564 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-245a4699-88e5-44d6-a590-00c5365c930d None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:40.409062 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-245a4699-88e5-44d6-a590-00c5365c930d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:40.461648 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c23a6-bd93-45ef-98f3-12a21694dc31 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:40.488087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:40.500676 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 334/682] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:40 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 01:11:40.505857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58067d50-aca3-432e-a742-6445574a3415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:40.505857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58067d50-aca3-432e-a742-6445574a3415 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:40.505857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58067d50-aca3-432e-a742-6445574a3415 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:40.505857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58067d50-aca3-432e-a742-6445574a3415 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:40.515251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58067d50-aca3-432e-a742-6445574a3415 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:40.517094 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58067d50-aca3-432e-a742-6445574a3415 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:40.530779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-58067d50-aca3-432e-a742-6445574a3415 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 01:11:40.530779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:40.530779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:40.530779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:40.530779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:40.530779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:40.530779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:40.530779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:40.530779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:40.530779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:40.530779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:40.530779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:40.530779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:11:40.530779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:11:40.530779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:11:40.530779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:40.531924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:40.533071 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:40.533071 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:40.533071 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:11:40.533071 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:11:40.533071 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:11:40.533071 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:11:40.533071 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:11:40.533071 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:11:40.533071 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 01:11:40.533071 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:40.535309 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 349/683] 10.222.0.82 () {56 vars in 1093 bytes} [Fri Aug 19 01:11:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:11:40.541868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a4699-88e5-44d6-a590-00c5365c930d None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:40.629259 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:40.661564 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a4699-88e5-44d6-a590-00c5365c930d None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:40.697523 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ebcf8-419e-461d-a245-5db93d1b349e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:40.698426 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ebcf8-419e-461d-a245-5db93d1b349e None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:40.698847 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ebcf8-419e-461d-a245-5db93d1b349e None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:40.699260 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ebcf8-419e-461d-a245-5db93d1b349e None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:40.700146 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ebcf8-419e-461d-a245-5db93d1b349e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:40.700643 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ebcf8-419e-461d-a245-5db93d1b349e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:40.702231 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ebcf8-419e-461d-a245-5db93d1b349e None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:40.721691 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 335/684] 10.222.0.82 () {56 vars in 1133 bytes} [Fri Aug 19 01:11:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:40.727395 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58067d50-aca3-432e-a742-6445574a3415 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:40.835283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58067d50-aca3-432e-a742-6445574a3415 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:40.861847 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ebcf8-419e-461d-a245-5db93d1b349e None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:40.871053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7489114-4106-40cc-80c3-0a7a3c61d7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:40.871781 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7489114-4106-40cc-80c3-0a7a3c61d7fb None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:40.872063 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7489114-4106-40cc-80c3-0a7a3c61d7fb None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:40.872337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7489114-4106-40cc-80c3-0a7a3c61d7fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:40.888752 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7489114-4106-40cc-80c3-0a7a3c61d7fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:40.890490 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7489114-4106-40cc-80c3-0a7a3c61d7fb None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:40.907213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-d7489114-4106-40cc-80c3-0a7a3c61d7fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:40.907213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:40.907213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:40.907213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:40.907213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:40.907213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:40.907213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:40.907213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:40.907213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:40.907213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:40.907213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:40.907213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:40.907213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:40.907213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:40.907213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:40.907213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:40.908436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:40.909541 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:40.909541 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:40.909541 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:40.915749 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 350/685] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:40.917387 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7489114-4106-40cc-80c3-0a7a3c61d7fb None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:40.955941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:40.996819 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ebcf8-419e-461d-a245-5db93d1b349e None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:41.034547 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7489114-4106-40cc-80c3-0a7a3c61d7fb None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:41.035757 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:41.045495 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e4eb0-7107-405f-8cf3-ddc21963f583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:41.047472 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e4eb0-7107-405f-8cf3-ddc21963f583 None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:41.047472 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e4eb0-7107-405f-8cf3-ddc21963f583 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:41.047472 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e4eb0-7107-405f-8cf3-ddc21963f583 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:41.047972 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e4eb0-7107-405f-8cf3-ddc21963f583 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:41.049599 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e4eb0-7107-405f-8cf3-ddc21963f583 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:41.076137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae6e5e-7016-41fd-b267-d9dde4bb30fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:41.077304 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6e5e-7016-41fd-b267-d9dde4bb30fb None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:41.077743 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6e5e-7016-41fd-b267-d9dde4bb30fb None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:41.078180 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6e5e-7016-41fd-b267-d9dde4bb30fb None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:41.078980 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae6e5e-7016-41fd-b267-d9dde4bb30fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:41.079463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae6e5e-7016-41fd-b267-d9dde4bb30fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:41.081012 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae6e5e-7016-41fd-b267-d9dde4bb30fb None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:41.098279 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 351/686] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:41.099476 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae6e5e-7016-41fd-b267-d9dde4bb30fb None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:41.132908 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 336/687] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Aug 19 01:11:40 2022] POST /identity/v3/services => generated 240 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:11:41.230123 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae6e5e-7016-41fd-b267-d9dde4bb30fb None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:41.233174 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:41.275975 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34424934-f2e2-4e3b-bd42-4db3fe636daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:41.276769 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34424934-f2e2-4e3b-bd42-4db3fe636daa None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:41.277083 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34424934-f2e2-4e3b-bd42-4db3fe636daa None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:41.277356 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34424934-f2e2-4e3b-bd42-4db3fe636daa None admin] PATH_INFO: `/v3/projects/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:41.285796 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34424934-f2e2-4e3b-bd42-4db3fe636daa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:41.287280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34424934-f2e2-4e3b-bd42-4db3fe636daa None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:41.300497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-34424934-f2e2-4e3b-bd42-4db3fe636daa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:41.300497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:41.300497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:41.300497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:41.300497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:41.300497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:41.300497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:41.300497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:41.300497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:41.300497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:41.300497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:41.300497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:41.300497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:11:41.300497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:11:41.300497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:41.301677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:41.302753 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:11:41.302753 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:11:41.302753 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:11:41.302753 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:11:41.302753 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:11:41.302753 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:11:41.302753 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:41.302753 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:41.305062 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 352/688] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:41.311191 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e4eb0-7107-405f-8cf3-ddc21963f583 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:41.435845 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e4eb0-7107-405f-8cf3-ddc21963f583 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:41.473134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7f146-1d2b-43ae-a4fb-5080453e641d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:41.473836 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7f146-1d2b-43ae-a4fb-5080453e641d None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:41.474187 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7f146-1d2b-43ae-a4fb-5080453e641d None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:41.474531 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7f146-1d2b-43ae-a4fb-5080453e641d None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:41.475295 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7f146-1d2b-43ae-a4fb-5080453e641d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:41.476362 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7f146-1d2b-43ae-a4fb-5080453e641d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:41.477937 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7f146-1d2b-43ae-a4fb-5080453e641d None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:41.492215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 337/689] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:41.498157 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34424934-f2e2-4e3b-bd42-4db3fe636daa None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:41.616947 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34424934-f2e2-4e3b-bd42-4db3fe636daa None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:41.660033 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed579aa-6aa0-4dfb-9995-ac5036b6b5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:41.660702 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed579aa-6aa0-4dfb-9995-ac5036b6b5b4 None admin] REQUEST_METHOD: `PUT` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:41.661005 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed579aa-6aa0-4dfb-9995-ac5036b6b5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:41.661343 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed579aa-6aa0-4dfb-9995-ac5036b6b5b4 None admin] PATH_INFO: `/v3/projects/b38e380f92824682a8286e59af2fc23c/users/ea9fe590dcf441b09f4fe18bf3d8a7ce/roles/fda5389edef24d6baac46d87242d285b` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:41.663340 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed579aa-6aa0-4dfb-9995-ac5036b6b5b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b38e380f92824682a8286e59af2fc23c, user_id=ea9fe590dcf441b09f4fe18bf3d8a7ce, role_id=fda5389edef24d6baac46d87242d285b)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:41.664795 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed579aa-6aa0-4dfb-9995-ac5036b6b5b4 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:41.735779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 353/690] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Aug 19 01:11:41 2022] PUT /identity/v3/projects/b38e380f92824682a8286e59af2fc23c/users/ea9fe590dcf441b09f4fe18bf3d8a7ce/roles/fda5389edef24d6baac46d87242d285b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:11:42.403903 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a925107-364c-453f-943e-b59caebd7b62 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:42.404453 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a925107-364c-453f-943e-b59caebd7b62 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:42.404453 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a925107-364c-453f-943e-b59caebd7b62 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:42.406066 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 338/691] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:42.411350 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3420d-40db-4147-8221-f66df7c88667 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:42.412071 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3420d-40db-4147-8221-f66df7c88667 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:42.412487 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3420d-40db-4147-8221-f66df7c88667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:42.431764 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-16a3420d-40db-4147-8221-f66df7c88667 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:42.434135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-16a3420d-40db-4147-8221-f66df7c88667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:42.437460 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:42.508519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 354/692] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:42 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 01:11:42.739472 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6768d-45ce-4d51-909b-440cd803c2ab None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:42.739824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6768d-45ce-4d51-909b-440cd803c2ab None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:42.740000 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6768d-45ce-4d51-909b-440cd803c2ab None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:42.741567 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 339/693] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:42.747572 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e573c5-43b1-4e77-8927-0ed4db8d0a3e None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:42.747867 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e573c5-43b1-4e77-8927-0ed4db8d0a3e None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:42.748154 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e573c5-43b1-4e77-8927-0ed4db8d0a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:42.766934 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-56e573c5-43b1-4e77-8927-0ed4db8d0a3e None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:42.768127 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-56e573c5-43b1-4e77-8927-0ed4db8d0a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:42.839670 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 355/694] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:42 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:11:42.857637 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6768d-45ce-4d51-909b-440cd803c2ab None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:42.917671 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:42.976236 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6768d-45ce-4d51-909b-440cd803c2ab None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:43.013574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8fba4-fd5b-48da-b5f3-ca417127f8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:43.014139 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8fba4-fd5b-48da-b5f3-ca417127f8d3 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:43.014423 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8fba4-fd5b-48da-b5f3-ca417127f8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:43.014701 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8fba4-fd5b-48da-b5f3-ca417127f8d3 None admin] PATH_INFO: `/v3/services/image` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:43.015284 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8fba4-fd5b-48da-b5f3-ca417127f8d3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:43.017088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8fba4-fd5b-48da-b5f3-ca417127f8d3 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-37f8fba4-fd5b-48da-b5f3-ca417127f8d3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:43.027892 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:43.028915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:43.028915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:43.028915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:43.028915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:43.028915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:43.028915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:43.028915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:11:43.028915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:11:43.028915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:11:43.028915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:11:43.028915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:43.028915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:43.028915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:43.028915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:43.028915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:43.028915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:43.030019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:43.030019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:43.030019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:43.030019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:43.030019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:43.030019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:43.030019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:43.030019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:43.030019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:43.030019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:43.030019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:11:43.030019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:43.030019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 01:11:43.030019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:43.030019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 340/695] 10.222.0.82 () {56 vars in 1105 bytes} [Fri Aug 19 01:11:42 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:43.038215 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e573c5-43b1-4e77-8927-0ed4db8d0a3e None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:43.111132 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:43.143487 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e573c5-43b1-4e77-8927-0ed4db8d0a3e None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:43.175194 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8fba4-fd5b-48da-b5f3-ca417127f8d3 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:43.185022 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f7ab6-18b0-4887-a1ee-ce7287d848b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:43.185926 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f7ab6-18b0-4887-a1ee-ce7287d848b4 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:43.186402 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f7ab6-18b0-4887-a1ee-ce7287d848b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:43.187006 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f7ab6-18b0-4887-a1ee-ce7287d848b4 None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:43.187837 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f7ab6-18b0-4887-a1ee-ce7287d848b4 None admin] RBAC: Adding query filter params (name=image) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:43.188460 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f7ab6-18b0-4887-a1ee-ce7287d848b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:43.190189 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f7ab6-18b0-4887-a1ee-ce7287d848b4 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:43.200358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 356/696] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:43.201994 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f7ab6-18b0-4887-a1ee-ce7287d848b4 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:43.280495 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8fba4-fd5b-48da-b5f3-ca417127f8d3 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:43.296174 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:43.318363 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f7ab6-18b0-4887-a1ee-ce7287d848b4 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:43.320655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d01d3c-90e7-459b-8b3b-2c409996f3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:43.321610 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d01d3c-90e7-459b-8b3b-2c409996f3d1 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:43.322148 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d01d3c-90e7-459b-8b3b-2c409996f3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:43.322750 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d01d3c-90e7-459b-8b3b-2c409996f3d1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:43.324221 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d01d3c-90e7-459b-8b3b-2c409996f3d1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:43.326991 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d01d3c-90e7-459b-8b3b-2c409996f3d1 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-d8d01d3c-90e7-459b-8b3b-2c409996f3d1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:43.337611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:43.339810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:43.339810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:43.339810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:43.339810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:43.339810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:43.339810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:43.339810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:11:43.339810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:11:43.339810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:11:43.339810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:11:43.339810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:43.339810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:43.339810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:43.339810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:43.339810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:43.339810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:43.340668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:43.340668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:43.340668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:43.340668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:43.340668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:43.340668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:43.340668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:43.340668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:43.340668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:43.340668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:43.340668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:11:43.340668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:43.340668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 01:11:43.340668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:43.343353 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 341/697] 10.222.0.82 () {56 vars in 1129 bytes} [Fri Aug 19 01:11:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:11:43.350039 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d01d3c-90e7-459b-8b3b-2c409996f3d1 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:43.358633 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f297d0a-506c-4cad-8607-d9407a53a008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:43.359240 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f297d0a-506c-4cad-8607-d9407a53a008 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:43.359548 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f297d0a-506c-4cad-8607-d9407a53a008 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:43.359824 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f297d0a-506c-4cad-8607-d9407a53a008 None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:43.360449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f297d0a-506c-4cad-8607-d9407a53a008 None admin] RBAC: Adding query filter params (type=image) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:43.360740 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f297d0a-506c-4cad-8607-d9407a53a008 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:43.362256 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f297d0a-506c-4cad-8607-d9407a53a008 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:43.363703 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:43.368641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 357/698] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:43.375046 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f297d0a-506c-4cad-8607-d9407a53a008 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:43.488644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f297d0a-506c-4cad-8607-d9407a53a008 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:43.495261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d01d3c-90e7-459b-8b3b-2c409996f3d1 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:43.527411 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fc02f-e424-4f3c-9ec0-cf82a8311fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:43.528024 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fc02f-e424-4f3c-9ec0-cf82a8311fc5 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:43.528547 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fc02f-e424-4f3c-9ec0-cf82a8311fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:43.528547 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fc02f-e424-4f3c-9ec0-cf82a8311fc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:43.529275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fc02f-e424-4f3c-9ec0-cf82a8311fc5 None admin] RBAC: Adding query filter params (interface=public, service_id=766b1efec6284abd99ba9a0f3b71f2e2, region_id=RegionOne) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:43.529579 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fc02f-e424-4f3c-9ec0-cf82a8311fc5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:43.530988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fc02f-e424-4f3c-9ec0-cf82a8311fc5 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:43.533580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a264516-082d-4b14-a9f9-0d9e76baa1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:43.534183 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a264516-082d-4b14-a9f9-0d9e76baa1cc None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:43.534458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a264516-082d-4b14-a9f9-0d9e76baa1cc None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:43.534724 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a264516-082d-4b14-a9f9-0d9e76baa1cc None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:43.535685 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a264516-082d-4b14-a9f9-0d9e76baa1cc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:43.535685 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a264516-082d-4b14-a9f9-0d9e76baa1cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:43.537038 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a264516-082d-4b14-a9f9-0d9e76baa1cc None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:43.540462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 358/699] 10.222.0.82 () {56 vars in 1251 bytes} [Fri Aug 19 01:11:43 2022] GET /identity/v3/endpoints?service_id=766b1efec6284abd99ba9a0f3b71f2e2&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:43.545251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceba102-a7a2-40fc-a462-1324af61c1ef None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:43.545537 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceba102-a7a2-40fc-a462-1324af61c1ef None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:43.545809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceba102-a7a2-40fc-a462-1324af61c1ef None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:43.551297 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 359/700] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:43.551297 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceba102-a7a2-40fc-a462-1324af61c1ef None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:43.551528 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 342/701] 10.222.0.82 () {56 vars in 1124 bytes} [Fri Aug 19 01:11:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:43.552920 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a264516-082d-4b14-a9f9-0d9e76baa1cc None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:43.597066 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:43.618202 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:43.658284 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a264516-082d-4b14-a9f9-0d9e76baa1cc None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:43.663174 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceba102-a7a2-40fc-a462-1324af61c1ef None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:43.696023 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06eada2-aa3a-44c0-9f17-60d77e1c10c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:43.696620 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06eada2-aa3a-44c0-9f17-60d77e1c10c7 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:43.696940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06eada2-aa3a-44c0-9f17-60d77e1c10c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:43.697185 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06eada2-aa3a-44c0-9f17-60d77e1c10c7 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:43.697878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06eada2-aa3a-44c0-9f17-60d77e1c10c7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:43.698176 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06eada2-aa3a-44c0-9f17-60d77e1c10c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:43.699121 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39da91-83e5-46ca-89a3-3ac375f0dd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:43.699534 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06eada2-aa3a-44c0-9f17-60d77e1c10c7 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:43.699728 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39da91-83e5-46ca-89a3-3ac375f0dd68 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:43.700008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39da91-83e5-46ca-89a3-3ac375f0dd68 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:43.700278 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39da91-83e5-46ca-89a3-3ac375f0dd68 None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:43.700894 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39da91-83e5-46ca-89a3-3ac375f0dd68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:43.702242 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39da91-83e5-46ca-89a3-3ac375f0dd68 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:43.704702 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 343/702] 10.222.0.82 () {56 vars in 1124 bytes} [Fri Aug 19 01:11:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:43.715592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 360/703] 10.222.0.82 () {56 vars in 1087 bytes} [Fri Aug 19 01:11:43 2022] GET /identity/v3/services => generated 1002 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:11:43.715787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa246058-b8bd-4004-8210-6ae2c9528e49 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:43.715787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa246058-b8bd-4004-8210-6ae2c9528e49 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:43.715787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa246058-b8bd-4004-8210-6ae2c9528e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:43.716003 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39da91-83e5-46ca-89a3-3ac375f0dd68 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:43.733379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-fa246058-b8bd-4004-8210-6ae2c9528e49 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:43.734591 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-fa246058-b8bd-4004-8210-6ae2c9528e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:43.814350 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 344/704] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:43 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:11:43.844387 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39da91-83e5-46ca-89a3-3ac375f0dd68 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:43.873965 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:43.883476 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cb0fb-b0bd-4e28-8dcb-b5d14c592012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:43.884108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cb0fb-b0bd-4e28-8dcb-b5d14c592012 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:43.884388 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cb0fb-b0bd-4e28-8dcb-b5d14c592012 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:43.884664 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cb0fb-b0bd-4e28-8dcb-b5d14c592012 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:43.886251 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cb0fb-b0bd-4e28-8dcb-b5d14c592012 None admin] RBAC: Adding query filter params (interface=public, service_id=480148d46b8241d49d2c492fbd62e197, region_id=RegionOne) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:43.886727 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cb0fb-b0bd-4e28-8dcb-b5d14c592012 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:43.888288 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cb0fb-b0bd-4e28-8dcb-b5d14c592012 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:43.894840 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 361/705] 10.222.0.82 () {56 vars in 1251 bytes} [Fri Aug 19 01:11:43 2022] GET /identity/v3/endpoints?service_id=480148d46b8241d49d2c492fbd62e197&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:43.900498 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa246058-b8bd-4004-8210-6ae2c9528e49 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:43.941349 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:44.016278 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa246058-b8bd-4004-8210-6ae2c9528e49 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:44.052781 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9656a-6672-43c0-b985-291c363aaded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:44.053433 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9656a-6672-43c0-b985-291c363aaded None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:44.054064 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9656a-6672-43c0-b985-291c363aaded None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:44.054333 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9656a-6672-43c0-b985-291c363aaded None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:44.054933 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9656a-6672-43c0-b985-291c363aaded None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:44.056352 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9656a-6672-43c0-b985-291c363aaded None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:44.062262 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 345/706] 10.222.0.82 () {56 vars in 1087 bytes} [Fri Aug 19 01:11:43 2022] GET /identity/v3/services => generated 1002 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:11:44.137316 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ec6ae-1f0b-48f6-af2f-ebff63cb04e1 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:44.137651 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ec6ae-1f0b-48f6-af2f-ebff63cb04e1 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:44.137875 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ec6ae-1f0b-48f6-af2f-ebff63cb04e1 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:44.139553 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 362/707] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:44.145503 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44782ef4-1891-428f-8f0b-e0b83c5fc3c1 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:44.145809 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44782ef4-1891-428f-8f0b-e0b83c5fc3c1 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:44.146056 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44782ef4-1891-428f-8f0b-e0b83c5fc3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:44.161218 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ec6ae-1f0b-48f6-af2f-ebff63cb04e1 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:44.167805 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-44782ef4-1891-428f-8f0b-e0b83c5fc3c1 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:44.169063 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-44782ef4-1891-428f-8f0b-e0b83c5fc3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:44.264125 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 346/708] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:44 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:11:44.283738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ec6ae-1f0b-48f6-af2f-ebff63cb04e1 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:44.320308 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5985a-faf5-4750-a975-0396430b733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:44.320973 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5985a-faf5-4750-a975-0396430b733e None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:44.321252 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5985a-faf5-4750-a975-0396430b733e None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:44.321524 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5985a-faf5-4750-a975-0396430b733e None admin] PATH_INFO: `/v3/services/network` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:44.322100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5985a-faf5-4750-a975-0396430b733e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:44.324012 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5985a-faf5-4750-a975-0396430b733e None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-f5c5985a-faf5-4750-a975-0396430b733e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:44.333250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:44.334241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:44.334241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:44.334241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:44.334241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:44.334241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:44.334241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:44.334241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:11:44.334241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:11:44.334241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:11:44.334241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:11:44.334241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:44.334241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:44.334241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:44.334241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:44.334241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:44.334241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:44.335458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:44.335458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:44.335458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:44.335458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:44.335458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:44.335458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:44.335458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:44.335458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:44.335458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:44.335458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:44.335458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:11:44.335458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:44.335458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 01:11:44.335458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:44.335458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 363/709] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:44 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:44.341082 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44782ef4-1891-428f-8f0b-e0b83c5fc3c1 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:44.371271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:44.447503 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44782ef4-1891-428f-8f0b-e0b83c5fc3c1 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:44.483615 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa91ee6-94d8-4a7f-a43a-d67a787985a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:44.484229 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa91ee6-94d8-4a7f-a43a-d67a787985a8 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:44.484511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa91ee6-94d8-4a7f-a43a-d67a787985a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:44.484782 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa91ee6-94d8-4a7f-a43a-d67a787985a8 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:44.485449 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa91ee6-94d8-4a7f-a43a-d67a787985a8 None admin] RBAC: Adding query filter params (name=network) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:44.485750 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa91ee6-94d8-4a7f-a43a-d67a787985a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:44.487132 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa91ee6-94d8-4a7f-a43a-d67a787985a8 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:44.492158 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 347/710] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Aug 19 01:11:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:44.498350 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5985a-faf5-4750-a975-0396430b733e None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:44.565003 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:44.603238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa91ee6-94d8-4a7f-a43a-d67a787985a8 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:44.613140 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5985a-faf5-4750-a975-0396430b733e None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:44.651021 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c85155-60af-47fc-9918-fcff984642d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:44.652057 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c85155-60af-47fc-9918-fcff984642d8 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:44.652561 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c85155-60af-47fc-9918-fcff984642d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:44.653069 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c85155-60af-47fc-9918-fcff984642d8 None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:44.653927 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c85155-60af-47fc-9918-fcff984642d8 None admin] RBAC: Adding query filter params (type=network) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:44.654427 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c85155-60af-47fc-9918-fcff984642d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:44.655988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c85155-60af-47fc-9918-fcff984642d8 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:44.661966 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 364/711] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Aug 19 01:11:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:44.668952 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c85155-60af-47fc-9918-fcff984642d8 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:44.733424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa91ee6-94d8-4a7f-a43a-d67a787985a8 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:44.749325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:44.772720 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62999f17-eb67-43f8-9052-d2e3761b14b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:44.773412 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62999f17-eb67-43f8-9052-d2e3761b14b6 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:44.773691 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62999f17-eb67-43f8-9052-d2e3761b14b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:44.773964 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62999f17-eb67-43f8-9052-d2e3761b14b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:44.776585 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c85155-60af-47fc-9918-fcff984642d8 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:44.785065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62999f17-eb67-43f8-9052-d2e3761b14b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:11:44.790048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-62999f17-eb67-43f8-9052-d2e3761b14b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:11:44.790048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:44.790048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:44.790048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:44.790048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:44.790048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:44.790048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:44.790048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:44.790048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:44.790048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:44.790048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:44.790048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:44.790048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:11:44.790048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:11:44.790048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:11:44.790048 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:11:44.791005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:11:44.791005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:11:44.791005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:11:44.791005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:11:44.791005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:44.791005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:44.791005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:44.791005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:44.791005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:44.791005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:44.791005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:44.791005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:44.791005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:44.791005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:44.791005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:44.791005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:44.797321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:44.797321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:44.797321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:44.797321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:44.797321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:11:44.797321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:11:44.797321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:11:44.797321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:11:44.797321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:11:44.797321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:11:44.797321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:11:44.797321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:44.797321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 348/712] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:11:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:11:44.798060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62999f17-eb67-43f8-9052-d2e3761b14b6 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:44.809143 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:44.830059 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a3452-5b35-4813-aef5-665495d38e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:44.831047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a3452-5b35-4813-aef5-665495d38e8c None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:44.831578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a3452-5b35-4813-aef5-665495d38e8c None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:44.832216 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a3452-5b35-4813-aef5-665495d38e8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:44.833129 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a3452-5b35-4813-aef5-665495d38e8c None admin] RBAC: Adding query filter params (interface=public, service_id=376ea6d539944e7c9bbd325cbe2850df, region_id=RegionOne) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:44.833725 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a3452-5b35-4813-aef5-665495d38e8c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:44.835588 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a3452-5b35-4813-aef5-665495d38e8c None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:44.842586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 365/713] 10.222.0.82 () {56 vars in 1251 bytes} [Fri Aug 19 01:11:44 2022] GET /identity/v3/endpoints?service_id=376ea6d539944e7c9bbd325cbe2850df&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:44.847710 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a3452-5b35-4813-aef5-665495d38e8c None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:44.918236 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62999f17-eb67-43f8-9052-d2e3761b14b6 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:44.958815 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1e243-5f3d-4e34-b280-590e6a78425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:44.959530 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1e243-5f3d-4e34-b280-590e6a78425f None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:44.959810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1e243-5f3d-4e34-b280-590e6a78425f None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:44.960127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1e243-5f3d-4e34-b280-590e6a78425f None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:44.960818 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1e243-5f3d-4e34-b280-590e6a78425f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:44.961159 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1e243-5f3d-4e34-b280-590e6a78425f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:44.962823 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1e243-5f3d-4e34-b280-590e6a78425f None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:44.977617 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 349/714] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:11:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:44.978620 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1e243-5f3d-4e34-b280-590e6a78425f None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:44.983159 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a3452-5b35-4813-aef5-665495d38e8c None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:44.997745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:45.033699 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29256c-52ca-4d8e-856e-4fc4fc997bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:45.034781 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29256c-52ca-4d8e-856e-4fc4fc997bfb None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:45.035276 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29256c-52ca-4d8e-856e-4fc4fc997bfb None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:45.035991 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29256c-52ca-4d8e-856e-4fc4fc997bfb None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:45.036972 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29256c-52ca-4d8e-856e-4fc4fc997bfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:45.039352 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29256c-52ca-4d8e-856e-4fc4fc997bfb None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:45.057565 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 366/715] 10.222.0.82 () {56 vars in 1087 bytes} [Fri Aug 19 01:11:44 2022] GET /identity/v3/services => generated 1002 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:11:45.101056 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1e243-5f3d-4e34-b280-590e6a78425f None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:45.144340 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a8a20-6c97-450c-9ce2-08e809fd8a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:45.145396 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a8a20-6c97-450c-9ce2-08e809fd8a35 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:45.145888 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a8a20-6c97-450c-9ce2-08e809fd8a35 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:45.146362 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a8a20-6c97-450c-9ce2-08e809fd8a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:45.160272 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a8a20-6c97-450c-9ce2-08e809fd8a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:45.166105 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a8a20-6c97-450c-9ce2-08e809fd8a35 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:45.179181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-822a8a20-6c97-450c-9ce2-08e809fd8a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:45.179181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:45.179181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:45.179181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:45.179181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:45.179181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:45.179181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:45.179181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:45.179181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:45.179181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:45.179181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:45.179181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:45.179181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:45.179181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:45.179181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:45.179181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:45.180252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:45.181206 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:45.181206 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:45.181206 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:45.181206 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 350/716] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:45.186324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29256c-52ca-4d8e-856e-4fc4fc997bfb None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:45.249704 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:45.309216 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29256c-52ca-4d8e-856e-4fc4fc997bfb None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:45.346605 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75e4ca-c132-4d92-a2c2-a75247474735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:45.347235 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75e4ca-c132-4d92-a2c2-a75247474735 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:45.347517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75e4ca-c132-4d92-a2c2-a75247474735 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:45.347776 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75e4ca-c132-4d92-a2c2-a75247474735 None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:45.348427 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75e4ca-c132-4d92-a2c2-a75247474735 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:45.348786 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75e4ca-c132-4d92-a2c2-a75247474735 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:45.350141 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75e4ca-c132-4d92-a2c2-a75247474735 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:45.363124 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 367/717] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:45.368641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a8a20-6c97-450c-9ce2-08e809fd8a35 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:45.441688 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:45.481023 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a8a20-6c97-450c-9ce2-08e809fd8a35 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:45.516385 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f137b52-7bd3-48d3-8404-c6dcb2950181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:45.516971 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f137b52-7bd3-48d3-8404-c6dcb2950181 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:45.517252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f137b52-7bd3-48d3-8404-c6dcb2950181 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:45.517528 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f137b52-7bd3-48d3-8404-c6dcb2950181 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:45.526403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f137b52-7bd3-48d3-8404-c6dcb2950181 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:45.528532 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f137b52-7bd3-48d3-8404-c6dcb2950181 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:45.539919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-4f137b52-7bd3-48d3-8404-c6dcb2950181 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 01:11:45.539919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:45.539919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:45.539919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:45.539919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:45.539919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:45.539919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:45.539919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:45.539919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:45.539919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:45.539919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:45.539919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:45.539919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:11:45.539919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:11:45.539919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:11:45.539919 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:45.542424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:45.543612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:45.543612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:45.543612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:11:45.543612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:11:45.543612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:11:45.543612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:11:45.543612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:11:45.543612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:11:45.543612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 01:11:45.543612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:45.543612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 351/718] 10.222.0.82 () {56 vars in 1093 bytes} [Fri Aug 19 01:11:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:45.551987 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75e4ca-c132-4d92-a2c2-a75247474735 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:45.669743 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75e4ca-c132-4d92-a2c2-a75247474735 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:45.677026 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:45.706496 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ec9b4-d5c8-42a5-8bc4-c916c01f99ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:45.707118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ec9b4-d5c8-42a5-8bc4-c916c01f99ed None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:45.707396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ec9b4-d5c8-42a5-8bc4-c916c01f99ed None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:45.707666 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ec9b4-d5c8-42a5-8bc4-c916c01f99ed None admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:45.708406 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ec9b4-d5c8-42a5-8bc4-c916c01f99ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:45.708707 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ec9b4-d5c8-42a5-8bc4-c916c01f99ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:45.710182 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ec9b4-d5c8-42a5-8bc4-c916c01f99ed None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:45.731079 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 368/719] 10.222.0.82 () {56 vars in 1133 bytes} [Fri Aug 19 01:11:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:45.737959 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f137b52-7bd3-48d3-8404-c6dcb2950181 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:45.849360 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f137b52-7bd3-48d3-8404-c6dcb2950181 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:45.876878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:45.886344 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481098eb-7350-46d1-8808-674f20289865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:45.887043 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481098eb-7350-46d1-8808-674f20289865 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:45.887362 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481098eb-7350-46d1-8808-674f20289865 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:45.887651 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481098eb-7350-46d1-8808-674f20289865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:46.088816 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481098eb-7350-46d1-8808-674f20289865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:46.090513 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481098eb-7350-46d1-8808-674f20289865 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:46.120167 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbcc76-8563-4527-8a3c-000fd3c90c2d None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:46.120475 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbcc76-8563-4527-8a3c-000fd3c90c2d None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:46.120721 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbcc76-8563-4527-8a3c-000fd3c90c2d None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:46.122149 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 369/720] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:46.129859 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aa937-1394-4977-b7ec-731926ac3acf None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:46.130142 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aa937-1394-4977-b7ec-731926ac3acf None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:46.130420 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aa937-1394-4977-b7ec-731926ac3acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:46.153273 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-3e8aa937-1394-4977-b7ec-731926ac3acf None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:46.153273 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-3e8aa937-1394-4977-b7ec-731926ac3acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:46.209189 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 352/721] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:11:45 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 01:11:46.215586 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481098eb-7350-46d1-8808-674f20289865 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:46.237223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 370/722] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:46 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:11:46.253295 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:46.332519 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481098eb-7350-46d1-8808-674f20289865 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:46.368585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5b974-02cd-47df-9850-d7b05185cd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:46.369268 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5b974-02cd-47df-9850-d7b05185cd02 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:46.369684 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5b974-02cd-47df-9850-d7b05185cd02 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:46.370235 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5b974-02cd-47df-9850-d7b05185cd02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:46.381241 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5b974-02cd-47df-9850-d7b05185cd02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:46.382782 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5b974-02cd-47df-9850-d7b05185cd02 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:46.398471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-9cd5b974-02cd-47df-9850-d7b05185cd02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:46.398471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:46.398471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:46.398471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:46.398471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:46.398471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:46.398471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:46.398471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:46.398471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:46.398471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:46.398471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:46.398471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:46.398471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:46.398471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:46.398471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:46.398471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:46.399466 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:46.400346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:46.400346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:46.400346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:46.400528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8cb87-5a0b-4254-a466-fcc15fa8bb40 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:46.400602 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 353/723] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:46.400755 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8cb87-5a0b-4254-a466-fcc15fa8bb40 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:46.400755 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8cb87-5a0b-4254-a466-fcc15fa8bb40 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:46.402383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 371/724] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:46.407054 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8cb87-5a0b-4254-a466-fcc15fa8bb40 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:46.407360 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa62ca-ec57-4c19-a252-3acb376aa57d None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:46.407650 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa62ca-ec57-4c19-a252-3acb376aa57d None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:46.407925 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa62ca-ec57-4c19-a252-3acb376aa57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:46.431220 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-3eaa62ca-ec57-4c19-a252-3acb376aa57d None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:46.433540 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-3eaa62ca-ec57-4c19-a252-3acb376aa57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:46.515741 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 354/725] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:46 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:11:46.597967 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa62ca-ec57-4c19-a252-3acb376aa57d None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:46.610280 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:46.641658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:46.651607 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8cb87-5a0b-4254-a466-fcc15fa8bb40 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:46.693417 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de5ece-14da-42e3-9992-e5435a2dd550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:46.694381 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de5ece-14da-42e3-9992-e5435a2dd550 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:46.694668 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de5ece-14da-42e3-9992-e5435a2dd550 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:46.694986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de5ece-14da-42e3-9992-e5435a2dd550 None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:46.695629 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de5ece-14da-42e3-9992-e5435a2dd550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:46.695930 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de5ece-14da-42e3-9992-e5435a2dd550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:46.698516 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de5ece-14da-42e3-9992-e5435a2dd550 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:46.712770 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 372/726] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:46.718975 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de5ece-14da-42e3-9992-e5435a2dd550 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:46.747402 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa62ca-ec57-4c19-a252-3acb376aa57d None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:46.794317 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb2ada-a526-4bf2-a958-5fecd500d445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:46.795483 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2ada-a526-4bf2-a958-5fecd500d445 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:46.795917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2ada-a526-4bf2-a958-5fecd500d445 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:46.796344 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2ada-a526-4bf2-a958-5fecd500d445 None admin] PATH_INFO: `/v3/services/image` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:46.797115 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb2ada-a526-4bf2-a958-5fecd500d445 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:46.799523 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb2ada-a526-4bf2-a958-5fecd500d445 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-f8bb2ada-a526-4bf2-a958-5fecd500d445 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:46.811774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:46.813032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:46.813032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:46.813032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:46.813032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:46.813032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:46.813032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:46.813032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:11:46.813032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:11:46.813032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:11:46.813032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:11:46.813032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:46.813032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:46.813032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:46.813032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:46.813032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:46.813032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:46.814128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:46.814128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:46.814128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:46.814128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:46.814128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:46.814128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:46.814128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:46.814128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:46.814128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:46.814128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:46.814128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:11:46.814128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:46.814128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 01:11:46.814128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:46.817385 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 355/727] 10.222.0.82 () {56 vars in 1105 bytes} [Fri Aug 19 01:11:46 2022] GET /identity/v3/services/image => generated 86 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:46.824932 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb2ada-a526-4bf2-a958-5fecd500d445 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:46.849811 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de5ece-14da-42e3-9992-e5435a2dd550 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:46.887419 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e8cbc-c2f2-4c7d-8a9f-4d337c58b56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:46.888336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e8cbc-c2f2-4c7d-8a9f-4d337c58b56f None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:46.888622 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e8cbc-c2f2-4c7d-8a9f-4d337c58b56f None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:46.888925 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e8cbc-c2f2-4c7d-8a9f-4d337c58b56f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:46.895975 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e8cbc-c2f2-4c7d-8a9f-4d337c58b56f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:46.898162 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e8cbc-c2f2-4c7d-8a9f-4d337c58b56f None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:46.910222 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:46.910950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-e14e8cbc-c2f2-4c7d-8a9f-4d337c58b56f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:46.910950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:46.910950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:46.910950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:46.910950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:46.910950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:46.910950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:46.910950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:46.910950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:46.910950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:46.910950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:46.910950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:46.910950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:11:46.910950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:11:46.910950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:46.911868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:46.912754 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:11:46.912754 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:11:46.912754 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:11:46.912754 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:11:46.912754 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:11:46.912754 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:11:46.912754 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:11:46.912754 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:46.917442 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 373/728] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:11:46.922791 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e8cbc-c2f2-4c7d-8a9f-4d337c58b56f None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:46.937439 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:46.942730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb2ada-a526-4bf2-a958-5fecd500d445 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:46.982076 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf811b-071a-4906-bb94-75745b7dec90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:46.982770 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf811b-071a-4906-bb94-75745b7dec90 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:46.982951 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf811b-071a-4906-bb94-75745b7dec90 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:46.983217 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf811b-071a-4906-bb94-75745b7dec90 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:46.983834 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf811b-071a-4906-bb94-75745b7dec90 None admin] RBAC: Adding query filter params (name=image) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:46.984125 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf811b-071a-4906-bb94-75745b7dec90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:46.985508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf811b-071a-4906-bb94-75745b7dec90 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:46.990112 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 356/729] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:46.990930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf811b-071a-4906-bb94-75745b7dec90 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:47.034204 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e8cbc-c2f2-4c7d-8a9f-4d337c58b56f None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:47.071571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3f51a-c0f7-468a-a508-beccafa859d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:47.072205 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f51a-c0f7-468a-a508-beccafa859d1 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:47.072574 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f51a-c0f7-468a-a508-beccafa859d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:47.073867 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f51a-c0f7-468a-a508-beccafa859d1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:47.074557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3f51a-c0f7-468a-a508-beccafa859d1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:47.076279 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3f51a-c0f7-468a-a508-beccafa859d1 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-35d3f51a-c0f7-468a-a508-beccafa859d1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:47.085510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:47.086514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:47.086514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:47.086514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:47.086514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:47.086514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:47.086514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:47.086514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:11:47.086514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:11:47.086514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:11:47.086514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:11:47.086514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:47.086514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:47.086514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:47.086514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:47.086514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:47.086514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:47.087391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:47.087391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:47.087391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:47.087391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:47.087391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:47.087391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:47.087391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:47.087391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:47.087391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:47.087391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:47.087391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:11:47.087391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:47.087391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 01:11:47.087391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:47.087391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 374/730] 10.222.0.82 () {56 vars in 1129 bytes} [Fri Aug 19 01:11:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:47.088278 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3f51a-c0f7-468a-a508-beccafa859d1 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:47.104455 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf811b-071a-4906-bb94-75745b7dec90 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:47.142967 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8aa0e-958e-4cbd-a795-a25eb749be6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:47.143573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8aa0e-958e-4cbd-a795-a25eb749be6b None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:47.143844 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8aa0e-958e-4cbd-a795-a25eb749be6b None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:47.144109 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8aa0e-958e-4cbd-a795-a25eb749be6b None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:47.144790 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8aa0e-958e-4cbd-a795-a25eb749be6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:47.145126 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8aa0e-958e-4cbd-a795-a25eb749be6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:47.146609 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8aa0e-958e-4cbd-a795-a25eb749be6b None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:47.149268 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:47.164357 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 357/731] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:11:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:47.164357 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8aa0e-958e-4cbd-a795-a25eb749be6b None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:47.187408 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:47.208801 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3f51a-c0f7-468a-a508-beccafa859d1 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:47.243964 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685016-3bb8-4810-8ac9-deb6efe60cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:47.245458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685016-3bb8-4810-8ac9-deb6efe60cf6 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:47.245742 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685016-3bb8-4810-8ac9-deb6efe60cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:47.246014 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685016-3bb8-4810-8ac9-deb6efe60cf6 None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:47.246636 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9685016-3bb8-4810-8ac9-deb6efe60cf6 None admin] RBAC: Adding query filter params (type=image) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:47.246935 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9685016-3bb8-4810-8ac9-deb6efe60cf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:47.248314 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9685016-3bb8-4810-8ac9-deb6efe60cf6 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:47.253627 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 375/732] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:47.259035 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685016-3bb8-4810-8ac9-deb6efe60cf6 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:47.270507 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8aa0e-958e-4cbd-a795-a25eb749be6b None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:47.308250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73092308-a0e5-4e9b-9217-1ee5bf6016f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:47.308871 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73092308-a0e5-4e9b-9217-1ee5bf6016f3 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:47.309168 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73092308-a0e5-4e9b-9217-1ee5bf6016f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:47.309442 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73092308-a0e5-4e9b-9217-1ee5bf6016f3 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:47.310088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73092308-a0e5-4e9b-9217-1ee5bf6016f3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:47.310380 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73092308-a0e5-4e9b-9217-1ee5bf6016f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:47.311772 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73092308-a0e5-4e9b-9217-1ee5bf6016f3 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:47.316672 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 358/733] 10.222.0.82 () {56 vars in 1124 bytes} [Fri Aug 19 01:11:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:47.317481 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73092308-a0e5-4e9b-9217-1ee5bf6016f3 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:47.381159 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685016-3bb8-4810-8ac9-deb6efe60cf6 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:47.386426 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:47.417073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf57d1d-7309-4875-8317-8375d4401e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:47.417694 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf57d1d-7309-4875-8317-8375d4401e71 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:47.417969 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf57d1d-7309-4875-8317-8375d4401e71 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:47.418233 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf57d1d-7309-4875-8317-8375d4401e71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:47.418945 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf57d1d-7309-4875-8317-8375d4401e71 None admin] RBAC: Adding query filter params (role.id=fda5389edef24d6baac46d87242d285b, scope.project.id=b38e380f92824682a8286e59af2fc23c, user.id=ea9fe590dcf441b09f4fe18bf3d8a7ce) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:47.419246 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf57d1d-7309-4875-8317-8375d4401e71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:47.420665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf57d1d-7309-4875-8317-8375d4401e71 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:47.426523 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 376/734] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:11:47 2022] GET /identity/v3/role_assignments?user.id=ea9fe590dcf441b09f4fe18bf3d8a7ce&scope.project.id=b38e380f92824682a8286e59af2fc23c&role.id=fda5389edef24d6baac46d87242d285b => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:47.427299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf57d1d-7309-4875-8317-8375d4401e71 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:47.441422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73092308-a0e5-4e9b-9217-1ee5bf6016f3 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:47.443924 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:47.484821 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc7580-7511-44a3-993d-4a4b71e48605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:47.485884 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc7580-7511-44a3-993d-4a4b71e48605 None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:47.486171 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc7580-7511-44a3-993d-4a4b71e48605 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:47.486446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc7580-7511-44a3-993d-4a4b71e48605 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:47.487141 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc7580-7511-44a3-993d-4a4b71e48605 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:47.488566 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc7580-7511-44a3-993d-4a4b71e48605 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:47.549411 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf57d1d-7309-4875-8317-8375d4401e71 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:47.587159 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 359/735] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Aug 19 01:11:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:11:47.591129 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7c3e3-9db3-42a5-b94b-bfb7ec1ad1a5 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:47.591129 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7c3e3-9db3-42a5-b94b-bfb7ec1ad1a5 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:47.591129 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7c3e3-9db3-42a5-b94b-bfb7ec1ad1a5 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:47.592301 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 360/736] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:47.598036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950ede4-87fd-4e83-aa20-53665f636600 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:47.598346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950ede4-87fd-4e83-aa20-53665f636600 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:47.598595 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950ede4-87fd-4e83-aa20-53665f636600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:47.616287 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a98821-f736-40e8-84c2-c597ca46b9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:47.616628 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a98821-f736-40e8-84c2-c597ca46b9cd None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:47.617582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a98821-f736-40e8-84c2-c597ca46b9cd None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:47.617582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a98821-f736-40e8-84c2-c597ca46b9cd None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:47.617836 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a98821-f736-40e8-84c2-c597ca46b9cd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:47.618118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a98821-f736-40e8-84c2-c597ca46b9cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:47.620334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a98821-f736-40e8-84c2-c597ca46b9cd None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:47.627605 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-5950ede4-87fd-4e83-aa20-53665f636600 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:47.628049 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 377/737] 10.222.0.82 () {56 vars in 1124 bytes} [Fri Aug 19 01:11:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:47.628989 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-5950ede4-87fd-4e83-aa20-53665f636600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:47.634050 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a98821-f736-40e8-84c2-c597ca46b9cd None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:47.732962 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 361/738] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:47 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:11:47.751943 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:47.772464 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a98821-f736-40e8-84c2-c597ca46b9cd None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:47.808682 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27ee2f-a451-4a3b-bf80-b81edb590437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:47.809359 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27ee2f-a451-4a3b-bf80-b81edb590437 None admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:47.809665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27ee2f-a451-4a3b-bf80-b81edb590437 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:47.809935 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27ee2f-a451-4a3b-bf80-b81edb590437 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:47.810589 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27ee2f-a451-4a3b-bf80-b81edb590437 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:47.811959 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27ee2f-a451-4a3b-bf80-b81edb590437 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:47.890677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 378/739] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Aug 19 01:11:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:11:48.063361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950ede4-87fd-4e83-aa20-53665f636600 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:48.113555 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:48.170776 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950ede4-87fd-4e83-aa20-53665f636600 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:48.213091 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ab78c-760c-4614-ad01-afcd5f5d75ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:48.214662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ab78c-760c-4614-ad01-afcd5f5d75ab None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:48.215188 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ab78c-760c-4614-ad01-afcd5f5d75ab None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:48.215661 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ab78c-760c-4614-ad01-afcd5f5d75ab None admin] PATH_INFO: `/v3/services/network` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:48.216440 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ab78c-760c-4614-ad01-afcd5f5d75ab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:48.218110 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ab78c-760c-4614-ad01-afcd5f5d75ab None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-875ab78c-760c-4614-ad01-afcd5f5d75ab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:48.227592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:48.228597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:48.228597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:48.228597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:48.228597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:48.228597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:48.228597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:48.228597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:11:48.228597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:11:48.228597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:11:48.228597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:11:48.228597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:48.228597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:48.228597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:48.228597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:48.228597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:48.228597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:48.230157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:48.230157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:48.230157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:48.230157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:48.230157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:48.230157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:48.230157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:48.230157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:48.230157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:48.230157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:48.230157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:11:48.230157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:48.230157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 01:11:48.230157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:48.236956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 362/740] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:11:48 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:48.239025 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27ee2f-a451-4a3b-bf80-b81edb590437 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:48.349133 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27ee2f-a451-4a3b-bf80-b81edb590437 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:48.373666 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:48.385833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce853c5-9b68-4456-8b05-ad6bddd958e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:48.386458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce853c5-9b68-4456-8b05-ad6bddd958e9 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:48.386865 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce853c5-9b68-4456-8b05-ad6bddd958e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:48.389869 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce853c5-9b68-4456-8b05-ad6bddd958e9 None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:48.389869 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce853c5-9b68-4456-8b05-ad6bddd958e9 None admin] RBAC: Adding query filter params (name=network) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:48.389869 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce853c5-9b68-4456-8b05-ad6bddd958e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:48.389869 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce853c5-9b68-4456-8b05-ad6bddd958e9 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:48.394423 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 379/741] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Aug 19 01:11:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:48.400039 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ab78c-760c-4614-ad01-afcd5f5d75ab None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:48.514208 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ab78c-760c-4614-ad01-afcd5f5d75ab None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:48.521314 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:48.552753 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb67e1-9088-4795-bd97-43ea908711db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:48.553406 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb67e1-9088-4795-bd97-43ea908711db None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:48.553683 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb67e1-9088-4795-bd97-43ea908711db None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:48.554379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb67e1-9088-4795-bd97-43ea908711db None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:48.554565 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb67e1-9088-4795-bd97-43ea908711db None admin] RBAC: Adding query filter params (type=network) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:48.554865 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb67e1-9088-4795-bd97-43ea908711db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:48.556237 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb67e1-9088-4795-bd97-43ea908711db None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:48.562493 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 363/742] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Aug 19 01:11:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:48.569921 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce853c5-9b68-4456-8b05-ad6bddd958e9 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:48.681323 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce853c5-9b68-4456-8b05-ad6bddd958e9 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:48.719172 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25addfdd-5064-4d1b-8070-165c3a363d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:48.719781 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25addfdd-5064-4d1b-8070-165c3a363d81 None admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:48.720060 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25addfdd-5064-4d1b-8070-165c3a363d81 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:48.720330 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25addfdd-5064-4d1b-8070-165c3a363d81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:48.721020 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25addfdd-5064-4d1b-8070-165c3a363d81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:48.722431 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25addfdd-5064-4d1b-8070-165c3a363d81 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:48.799773 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 380/743] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Aug 19 01:11:48 2022] POST /identity/v3/endpoints => generated 337 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:11:49.769588 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511eeb2-734b-4f71-b4b2-0035cc204e07 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:49.770104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511eeb2-734b-4f71-b4b2-0035cc204e07 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:49.770104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511eeb2-734b-4f71-b4b2-0035cc204e07 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:49.771479 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 364/744] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:49.777083 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6db5f5-bffe-4d6d-a6f9-918cde458062 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:49.777375 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6db5f5-bffe-4d6d-a6f9-918cde458062 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:49.777650 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6db5f5-bffe-4d6d-a6f9-918cde458062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:49.795671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-fa6db5f5-bffe-4d6d-a6f9-918cde458062 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:49.796882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-fa6db5f5-bffe-4d6d-a6f9-918cde458062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:49.834228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:49.881005 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 381/745] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:49 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:11:50.008989 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12033d26-de2d-4e26-916a-ad8649a2c6c5 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:50.009333 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12033d26-de2d-4e26-916a-ad8649a2c6c5 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:50.009546 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12033d26-de2d-4e26-916a-ad8649a2c6c5 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:50.011685 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 365/746] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:50.016620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ed004-bbd5-40c0-8763-4378b42e0674 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:50.016951 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ed004-bbd5-40c0-8763-4378b42e0674 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:50.017233 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ed004-bbd5-40c0-8763-4378b42e0674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:50.035696 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-ee4ed004-bbd5-40c0-8763-4378b42e0674 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:50.037031 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-ee4ed004-bbd5-40c0-8763-4378b42e0674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:50.116720 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 382/747] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:50 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:11:50.212794 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12033d26-de2d-4e26-916a-ad8649a2c6c5 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:50.241487 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b18c92-2dd0-4de9-a477-0f876a7d8c1a None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:50.241799 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b18c92-2dd0-4de9-a477-0f876a7d8c1a None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:50.242038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b18c92-2dd0-4de9-a477-0f876a7d8c1a None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:50.243355 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 383/748] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:50.249259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca614f18-1d03-4bf5-b8e6-a1daca1a15db None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:50.249549 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca614f18-1d03-4bf5-b8e6-a1daca1a15db None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:50.249813 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca614f18-1d03-4bf5-b8e6-a1daca1a15db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:50.268662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-ca614f18-1d03-4bf5-b8e6-a1daca1a15db None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:50.270710 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-ca614f18-1d03-4bf5-b8e6-a1daca1a15db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:50.322291 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12033d26-de2d-4e26-916a-ad8649a2c6c5 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:50.342120 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 384/749] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:50 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 01:11:50.361319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a19a0a-f08c-405e-8d2c-9d8b54ace8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:50.361936 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a19a0a-f08c-405e-8d2c-9d8b54ace8bc None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:50.362208 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a19a0a-f08c-405e-8d2c-9d8b54ace8bc None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:50.362472 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a19a0a-f08c-405e-8d2c-9d8b54ace8bc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:50.363035 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a19a0a-f08c-405e-8d2c-9d8b54ace8bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:50.364390 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a19a0a-f08c-405e-8d2c-9d8b54ace8bc None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:50.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-33a19a0a-f08c-405e-8d2c-9d8b54ace8bc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 01:11:50.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:50.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:11:50.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:11:50.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:11:50.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:11:50.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:11:50.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:50.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 01:11:50.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:50.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:11:50.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:50.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:50.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:50.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:50.373165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:50.374065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:50.377939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:50.377939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:50.377939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:50.377939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:50.377939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:50.377939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:50.377939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:50.377939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:50.377939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:50.377939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:50.377939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:11:50.377939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:50.377939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 01:11:50.377939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:50.377939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 366/750] 10.222.0.82 () {56 vars in 1132 bytes} [Fri Aug 19 01:11:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:50.379989 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca614f18-1d03-4bf5-b8e6-a1daca1a15db None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:50.409797 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:50.453294 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a19a0a-f08c-405e-8d2c-9d8b54ace8bc None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:50.482021 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca614f18-1d03-4bf5-b8e6-a1daca1a15db None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:50.489831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:50.519527 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad6c1a-e660-4d93-bda7-cc9a6f765d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:50.520131 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad6c1a-e660-4d93-bda7-cc9a6f765d2d None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:50.520410 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad6c1a-e660-4d93-bda7-cc9a6f765d2d None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:50.520681 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad6c1a-e660-4d93-bda7-cc9a6f765d2d None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:50.521394 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad6c1a-e660-4d93-bda7-cc9a6f765d2d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:50.521696 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad6c1a-e660-4d93-bda7-cc9a6f765d2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:50.523309 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad6c1a-e660-4d93-bda7-cc9a6f765d2d None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:50.533584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 385/751] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Aug 19 01:11:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:50.534837 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad6c1a-e660-4d93-bda7-cc9a6f765d2d None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:50.573502 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a19a0a-f08c-405e-8d2c-9d8b54ace8bc None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:50.611737 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcec0f-8b7d-449e-8dc6-120c2fbc8dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:50.612342 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcec0f-8b7d-449e-8dc6-120c2fbc8dce None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:50.612620 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcec0f-8b7d-449e-8dc6-120c2fbc8dce None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:50.612915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcec0f-8b7d-449e-8dc6-120c2fbc8dce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:50.638850 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:50.646989 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad6c1a-e660-4d93-bda7-cc9a6f765d2d None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:50.681729 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbe002-7609-464d-a4ef-5b93a3eaefee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:50.682491 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbe002-7609-464d-a4ef-5b93a3eaefee None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:50.682770 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbe002-7609-464d-a4ef-5b93a3eaefee None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:50.683036 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbe002-7609-464d-a4ef-5b93a3eaefee None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:50.683653 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbe002-7609-464d-a4ef-5b93a3eaefee None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:50.683951 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbe002-7609-464d-a4ef-5b93a3eaefee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:50.685349 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbe002-7609-464d-a4ef-5b93a3eaefee None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:50.687740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcec0f-8b7d-449e-8dc6-120c2fbc8dce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:50.689198 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcec0f-8b7d-449e-8dc6-120c2fbc8dce None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:50.689712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 386/752] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Aug 19 01:11:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:50.690475 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbe002-7609-464d-a4ef-5b93a3eaefee None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:50.733633 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:50.810518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 367/753] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:11:50 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 01:11:50.815811 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcec0f-8b7d-449e-8dc6-120c2fbc8dce None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:50.824057 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbe002-7609-464d-a4ef-5b93a3eaefee None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:50.866073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fa01a-82b9-4b78-94b5-fc6a1cb565bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:50.867009 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fa01a-82b9-4b78-94b5-fc6a1cb565bc None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:50.867290 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fa01a-82b9-4b78-94b5-fc6a1cb565bc None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:50.867558 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fa01a-82b9-4b78-94b5-fc6a1cb565bc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:50.868315 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fa01a-82b9-4b78-94b5-fc6a1cb565bc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:50.870722 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fa01a-82b9-4b78-94b5-fc6a1cb565bc None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-f96fa01a-82b9-4b78-94b5-fc6a1cb565bc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:50.879846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:50.881056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:50.881056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:50.881056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:50.881056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:50.881056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:50.881056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:50.881056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:11:50.881056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:11:50.881056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:11:50.881056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:11:50.881056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:50.881056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:50.881056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:50.881056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:50.881056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:50.881056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:50.882979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:50.882979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:50.882979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:50.882979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:50.882979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:50.882979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:50.882979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:50.882979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:50.882979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:50.882979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:50.882979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:11:50.882979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:50.882979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 01:11:50.882979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:50.882979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 387/754] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:11:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:50.887174 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fa01a-82b9-4b78-94b5-fc6a1cb565bc None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:50.914010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:50.939626 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcec0f-8b7d-449e-8dc6-120c2fbc8dce None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:50.976238 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab54bb-ad7d-473e-91a6-cc1faa87c7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:50.976889 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab54bb-ad7d-473e-91a6-cc1faa87c7b7 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:50.977171 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab54bb-ad7d-473e-91a6-cc1faa87c7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:50.977441 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab54bb-ad7d-473e-91a6-cc1faa87c7b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:50.979664 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:50.988651 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab54bb-ad7d-473e-91a6-cc1faa87c7b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:50.990659 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab54bb-ad7d-473e-91a6-cc1faa87c7b7 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:51.005401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-2bab54bb-ad7d-473e-91a6-cc1faa87c7b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:51.005401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:51.005401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:51.005401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:51.005401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:51.005401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:51.005401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:51.005401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:51.005401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:51.005401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:51.005401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:51.005401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:51.005401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:11:51.005401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:11:51.005401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:11:51.005401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:51.006393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:11:51.007286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:11:51.007286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:11:51.007286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:51.007286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 368/755] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:11:51.008701 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fa01a-82b9-4b78-94b5-fc6a1cb565bc None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:51.012908 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab54bb-ad7d-473e-91a6-cc1faa87c7b7 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:51.047947 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb776763-976a-4bc5-81d7-55e8e75b580d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:51.048561 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb776763-976a-4bc5-81d7-55e8e75b580d None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:51.048894 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb776763-976a-4bc5-81d7-55e8e75b580d None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:51.049168 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb776763-976a-4bc5-81d7-55e8e75b580d None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:51.049796 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb776763-976a-4bc5-81d7-55e8e75b580d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:51.050101 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb776763-976a-4bc5-81d7-55e8e75b580d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:51.051465 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb776763-976a-4bc5-81d7-55e8e75b580d None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:51.056586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 388/756] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:11:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:51.064957 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb776763-976a-4bc5-81d7-55e8e75b580d None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:51.130838 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab54bb-ad7d-473e-91a6-cc1faa87c7b7 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:51.153696 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:51.167347 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d3088-7bd4-428f-9e8b-ff9c516e2b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:51.167885 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d3088-7bd4-428f-9e8b-ff9c516e2b4a None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:51.168164 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d3088-7bd4-428f-9e8b-ff9c516e2b4a None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:51.168431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d3088-7bd4-428f-9e8b-ff9c516e2b4a None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:51.168841 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb776763-976a-4bc5-81d7-55e8e75b580d None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:51.169110 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d3088-7bd4-428f-9e8b-ff9c516e2b4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:51.169433 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d3088-7bd4-428f-9e8b-ff9c516e2b4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:51.170795 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d3088-7bd4-428f-9e8b-ff9c516e2b4a None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:51.183631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 369/757] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:51.206041 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f65802-99ea-4a5c-ba88-995240ed7a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:51.206795 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f65802-99ea-4a5c-ba88-995240ed7a9c None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:51.207007 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f65802-99ea-4a5c-ba88-995240ed7a9c None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:51.207271 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f65802-99ea-4a5c-ba88-995240ed7a9c None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:51.207914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f65802-99ea-4a5c-ba88-995240ed7a9c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:51.208212 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f65802-99ea-4a5c-ba88-995240ed7a9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:51.209652 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f65802-99ea-4a5c-ba88-995240ed7a9c None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:51.215322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 389/758] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:11:51 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:52.939364 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156228b-541c-4ae5-9150-cf0a4dcc1c8e None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:52.939893 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156228b-541c-4ae5-9150-cf0a4dcc1c8e None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:52.939893 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156228b-541c-4ae5-9150-cf0a4dcc1c8e None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:52.941269 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 370/759] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:52.946524 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a55a2-1708-40cd-a786-a2efc2b581a8 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:52.946922 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a55a2-1708-40cd-a786-a2efc2b581a8 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:52.947068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a55a2-1708-40cd-a786-a2efc2b581a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:52.965345 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-4a9a55a2-1708-40cd-a786-a2efc2b581a8 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:52.966511 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-4a9a55a2-1708-40cd-a786-a2efc2b581a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:53.033712 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 390/760] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:52 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:11:53.360259 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156228b-541c-4ae5-9150-cf0a4dcc1c8e None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:53.408845 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:53.444718 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575223dd-1a34-4769-b65c-5b9d6d34da3c None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:53.445034 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575223dd-1a34-4769-b65c-5b9d6d34da3c None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:53.445309 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575223dd-1a34-4769-b65c-5b9d6d34da3c None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:53.446620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 391/761] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:11:53.452091 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48370dd-804e-43a9-9064-f5d2f04abc07 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:53.452371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48370dd-804e-43a9-9064-f5d2f04abc07 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:53.452641 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48370dd-804e-43a9-9064-f5d2f04abc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:53.462512 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156228b-541c-4ae5-9150-cf0a4dcc1c8e None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:53.470478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-f48370dd-804e-43a9-9064-f5d2f04abc07 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:53.471645 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-f48370dd-804e-43a9-9064-f5d2f04abc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:53.497626 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1166c5-0913-41a6-ab49-9f84040926e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:53.498228 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1166c5-0913-41a6-ab49-9f84040926e9 None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:53.498506 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1166c5-0913-41a6-ab49-9f84040926e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:53.498778 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1166c5-0913-41a6-ab49-9f84040926e9 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:53.499423 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1166c5-0913-41a6-ab49-9f84040926e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:53.500793 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1166c5-0913-41a6-ab49-9f84040926e9 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:53.536223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 392/762] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:53 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 01:11:53.576273 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 371/763] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Aug 19 01:11:53 2022] POST /identity/v3/services => generated 269 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:11:53.890616 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48370dd-804e-43a9-9064-f5d2f04abc07 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:53.902010 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:53.990379 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48370dd-804e-43a9-9064-f5d2f04abc07 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:54.030744 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb8b95-14e9-4d9d-9950-12e7589119cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:54.031355 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb8b95-14e9-4d9d-9950-12e7589119cc None admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:54.031637 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb8b95-14e9-4d9d-9950-12e7589119cc None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:54.031912 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb8b95-14e9-4d9d-9950-12e7589119cc None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:54.032561 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb8b95-14e9-4d9d-9950-12e7589119cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:54.034012 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb8b95-14e9-4d9d-9950-12e7589119cc None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:54.128613 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 393/764] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Aug 19 01:11:53 2022] POST /identity/v3/services => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:11:55.780180 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97c1e0-2e2e-49f0-aa02-ef51ffd656bd None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:55.780707 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97c1e0-2e2e-49f0-aa02-ef51ffd656bd None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:55.780707 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97c1e0-2e2e-49f0-aa02-ef51ffd656bd None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:55.782054 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 372/765] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:55.787184 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdea5b9-45f9-4d3a-a5b1-bd55ee724acd None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:55.787580 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdea5b9-45f9-4d3a-a5b1-bd55ee724acd None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:55.787745 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdea5b9-45f9-4d3a-a5b1-bd55ee724acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:55.805753 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-fcdea5b9-45f9-4d3a-a5b1-bd55ee724acd None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:55.807351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-fcdea5b9-45f9-4d3a-a5b1-bd55ee724acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:55.864256 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:55.878117 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 394/766] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:55 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:11:56.201237 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97c1e0-2e2e-49f0-aa02-ef51ffd656bd None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:56.299636 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97c1e0-2e2e-49f0-aa02-ef51ffd656bd None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:56.306413 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:56.321424 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e5744-1036-4c12-8460-92b97790d353 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:56.321840 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e5744-1036-4c12-8460-92b97790d353 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:56.322112 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e5744-1036-4c12-8460-92b97790d353 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:56.323746 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 395/767] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:11:56.328643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaa667-0a13-4424-8e91-6d919fc53800 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:56.328946 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaa667-0a13-4424-8e91-6d919fc53800 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:56.329225 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaa667-0a13-4424-8e91-6d919fc53800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:56.333659 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc6409-9abe-425c-8887-ec9b20b6e45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:56.334288 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc6409-9abe-425c-8887-ec9b20b6e45f None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:56.334571 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc6409-9abe-425c-8887-ec9b20b6e45f None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:56.334845 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc6409-9abe-425c-8887-ec9b20b6e45f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:56.335430 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc6409-9abe-425c-8887-ec9b20b6e45f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:56.336794 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc6409-9abe-425c-8887-ec9b20b6e45f None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:56.346071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-e2dc6409-9abe-425c-8887-ec9b20b6e45f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 01:11:56.346071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:56.346071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:11:56.346071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:11:56.346071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:11:56.346071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:11:56.346071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:11:56.346071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:56.346071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 01:11:56.346071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:56.346071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:11:56.346071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:56.346071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:56.346071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:56.346071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:56.346071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:56.351375 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:56.352245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:56.352245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:56.352245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:56.352245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:56.352245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:56.352245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:56.352245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:56.352245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:56.352245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:56.352245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:56.352245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:11:56.352245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:56.352245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 01:11:56.352245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:11:56.353078 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-2faaa667-0a13-4424-8e91-6d919fc53800 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:56.353152 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 373/768] 10.222.0.82 () {56 vars in 1132 bytes} [Fri Aug 19 01:11:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:56.353218 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-2faaa667-0a13-4424-8e91-6d919fc53800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:56.353300 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc6409-9abe-425c-8887-ec9b20b6e45f None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:56.415966 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 396/769] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:56 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 01:11:56.454044 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc6409-9abe-425c-8887-ec9b20b6e45f None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:56.486928 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a73627-40d0-4772-9905-6ff3e0e8a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:56.487529 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a73627-40d0-4772-9905-6ff3e0e8a90b None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:56.487811 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a73627-40d0-4772-9905-6ff3e0e8a90b None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:56.488085 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a73627-40d0-4772-9905-6ff3e0e8a90b None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:56.488706 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a73627-40d0-4772-9905-6ff3e0e8a90b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:56.489044 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a73627-40d0-4772-9905-6ff3e0e8a90b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:56.490412 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a73627-40d0-4772-9905-6ff3e0e8a90b None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:56.495491 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 374/770] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Aug 19 01:11:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:56.501337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaa667-0a13-4424-8e91-6d919fc53800 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:56.602710 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaa667-0a13-4424-8e91-6d919fc53800 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:56.623329 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:56.637666 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9a03f-71d7-4b11-b15b-4a627abe6a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:56.638274 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9a03f-71d7-4b11-b15b-4a627abe6a60 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:56.638548 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9a03f-71d7-4b11-b15b-4a627abe6a60 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:56.642141 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9a03f-71d7-4b11-b15b-4a627abe6a60 None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:56.642141 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9a03f-71d7-4b11-b15b-4a627abe6a60 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:56.642141 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9a03f-71d7-4b11-b15b-4a627abe6a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:56.642141 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9a03f-71d7-4b11-b15b-4a627abe6a60 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:56.645637 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 397/771] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Aug 19 01:11:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:56.652684 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a73627-40d0-4772-9905-6ff3e0e8a90b None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:56.688152 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:56.743953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9a03f-71d7-4b11-b15b-4a627abe6a60 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:56.753951 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a73627-40d0-4772-9905-6ff3e0e8a90b None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:56.788391 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9adbc7-dfde-4709-9af8-20f707740d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:56.789023 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9adbc7-dfde-4709-9af8-20f707740d06 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:56.789264 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9adbc7-dfde-4709-9af8-20f707740d06 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:56.789528 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9adbc7-dfde-4709-9af8-20f707740d06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:56.790203 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9adbc7-dfde-4709-9af8-20f707740d06 None admin] RBAC: Adding query filter params (interface=public, service_id=6b537d24bc394dd98773885c36b497d1, region_id=RegionOne) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:56.790502 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9adbc7-dfde-4709-9af8-20f707740d06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:56.791925 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9adbc7-dfde-4709-9af8-20f707740d06 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:56.798980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 375/772] 10.222.0.82 () {56 vars in 1251 bytes} [Fri Aug 19 01:11:56 2022] GET /identity/v3/endpoints?service_id=6b537d24bc394dd98773885c36b497d1&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:56.804435 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9adbc7-dfde-4709-9af8-20f707740d06 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:56.844054 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9a03f-71d7-4b11-b15b-4a627abe6a60 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:56.879762 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51436e9-06a2-4ab7-9ed8-9676368f2802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:56.880388 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51436e9-06a2-4ab7-9ed8-9676368f2802 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:56.880661 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51436e9-06a2-4ab7-9ed8-9676368f2802 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:56.880958 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51436e9-06a2-4ab7-9ed8-9676368f2802 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:56.881531 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51436e9-06a2-4ab7-9ed8-9676368f2802 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:56.882892 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51436e9-06a2-4ab7-9ed8-9676368f2802 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-d51436e9-06a2-4ab7-9ed8-9676368f2802 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:56.891998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:56.893030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:56.893030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:56.893030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:56.893030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:56.893030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:56.893030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:56.893030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:11:56.893030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:11:56.893030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:11:56.893030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:11:56.893030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:56.893030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:56.893030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:56.893030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:56.893030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:56.893030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:56.893882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:56.893882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:56.893882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:56.893882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:56.893882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:56.893882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:56.893882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:56.893882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:56.893882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:56.893882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:56.893882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:11:56.893882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:56.893882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 01:11:56.893882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:56.893882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 398/773] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:11:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:11:56.899047 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51436e9-06a2-4ab7-9ed8-9676368f2802 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:56.906765 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:56.911340 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9adbc7-dfde-4709-9af8-20f707740d06 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:56.946212 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c68457-3248-4482-88b9-68e3141b4ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:56.946806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c68457-3248-4482-88b9-68e3141b4ee1 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:56.947087 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c68457-3248-4482-88b9-68e3141b4ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:56.947349 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c68457-3248-4482-88b9-68e3141b4ee1 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:56.947937 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c68457-3248-4482-88b9-68e3141b4ee1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:56.948601 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:56.949337 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c68457-3248-4482-88b9-68e3141b4ee1 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:56.955051 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 376/774] 10.222.0.82 () {56 vars in 1087 bytes} [Fri Aug 19 01:11:56 2022] GET /identity/v3/services => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 01:11:57.004606 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51436e9-06a2-4ab7-9ed8-9676368f2802 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:57.042298 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffca31-a04e-4a5e-8509-9207c37d6bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:57.042914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffca31-a04e-4a5e-8509-9207c37d6bfa None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:57.043192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffca31-a04e-4a5e-8509-9207c37d6bfa None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:57.043462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffca31-a04e-4a5e-8509-9207c37d6bfa None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:57.044096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffca31-a04e-4a5e-8509-9207c37d6bfa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:57.044397 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffca31-a04e-4a5e-8509-9207c37d6bfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:57.045888 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffca31-a04e-4a5e-8509-9207c37d6bfa None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:57.051224 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 399/775] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:11:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:11:57.057716 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c68457-3248-4482-88b9-68e3141b4ee1 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:57.169101 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c68457-3248-4482-88b9-68e3141b4ee1 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:57.203018 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160408e-ae8a-493e-91c0-643178000c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:57.203662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160408e-ae8a-493e-91c0-643178000c03 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:57.203946 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160408e-ae8a-493e-91c0-643178000c03 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:57.204213 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160408e-ae8a-493e-91c0-643178000c03 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:57.204831 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160408e-ae8a-493e-91c0-643178000c03 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:57.205162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160408e-ae8a-493e-91c0-643178000c03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:57.206529 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160408e-ae8a-493e-91c0-643178000c03 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:57.211270 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 377/776] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:11:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:57.218243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffca31-a04e-4a5e-8509-9207c37d6bfa None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:57.320163 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffca31-a04e-4a5e-8509-9207c37d6bfa None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:57.333454 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:57.354985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbac8c2-5f1a-4d0d-9006-1cbfd36bb3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:57.355588 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbac8c2-5f1a-4d0d-9006-1cbfd36bb3d2 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:57.355868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbac8c2-5f1a-4d0d-9006-1cbfd36bb3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:57.356204 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbac8c2-5f1a-4d0d-9006-1cbfd36bb3d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:57.357111 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbac8c2-5f1a-4d0d-9006-1cbfd36bb3d2 None admin] RBAC: Adding query filter params (interface=public, service_id=9d8fd7d50e134c948c949def8bb0e6a5, region_id=RegionOne) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:57.357594 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbac8c2-5f1a-4d0d-9006-1cbfd36bb3d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:57.359217 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbac8c2-5f1a-4d0d-9006-1cbfd36bb3d2 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:57.364135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 400/777] 10.222.0.82 () {56 vars in 1251 bytes} [Fri Aug 19 01:11:57 2022] GET /identity/v3/endpoints?service_id=9d8fd7d50e134c948c949def8bb0e6a5&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:57.370451 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160408e-ae8a-493e-91c0-643178000c03 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:57.398820 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:57.470700 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160408e-ae8a-493e-91c0-643178000c03 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:57.504748 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02c7c7-c74e-4f77-b1d5-9b6cd1c42a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:57.505381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02c7c7-c74e-4f77-b1d5-9b6cd1c42a41 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:57.505662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02c7c7-c74e-4f77-b1d5-9b6cd1c42a41 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:57.505934 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02c7c7-c74e-4f77-b1d5-9b6cd1c42a41 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:57.506539 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02c7c7-c74e-4f77-b1d5-9b6cd1c42a41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:57.507906 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02c7c7-c74e-4f77-b1d5-9b6cd1c42a41 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:57.513902 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 378/778] 10.222.0.82 () {56 vars in 1087 bytes} [Fri Aug 19 01:11:57 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:11:59.130067 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6e2be-b662-4c6b-935c-eac2f8bfe964 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:59.130600 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6e2be-b662-4c6b-935c-eac2f8bfe964 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:59.130600 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6e2be-b662-4c6b-935c-eac2f8bfe964 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:59.131932 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 401/779] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:11:59.137758 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa853-82e1-4204-aba9-5825a5537322 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:59.138164 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa853-82e1-4204-aba9-5825a5537322 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:59.138392 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa853-82e1-4204-aba9-5825a5537322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:59.157055 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-9d1aa853-82e1-4204-aba9-5825a5537322 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:59.158245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-9d1aa853-82e1-4204-aba9-5825a5537322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:59.224721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 379/780] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:59 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:11:59.552805 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6e2be-b662-4c6b-935c-eac2f8bfe964 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:59.667014 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6e2be-b662-4c6b-935c-eac2f8bfe964 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:59.702356 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240079a-15ff-4b2a-b8e1-01af54969753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:59.702981 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240079a-15ff-4b2a-b8e1-01af54969753 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:59.703255 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240079a-15ff-4b2a-b8e1-01af54969753 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:59.703521 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240079a-15ff-4b2a-b8e1-01af54969753 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:59.704094 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240079a-15ff-4b2a-b8e1-01af54969753 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:59.705474 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240079a-15ff-4b2a-b8e1-01af54969753 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:59.714584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-e240079a-15ff-4b2a-b8e1-01af54969753 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 01:11:59.714584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:59.714584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:11:59.714584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:11:59.714584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:11:59.714584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:11:59.714584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:11:59.714584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:59.714584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 01:11:59.714584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:59.714584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:11:59.714584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:59.714584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:11:59.714584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:11:59.714584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:11:59.714584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:11:59.715598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:11:59.716647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:11:59.716647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:11:59.716647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:11:59.716647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:11:59.716647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:11:59.716647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:11:59.716647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:11:59.716647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:11:59.716647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:11:59.716647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:11:59.716647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:11:59.716647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:11:59.716647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 01:11:59.716647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:11:59.716647 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 402/781] 10.222.0.82 () {56 vars in 1132 bytes} [Fri Aug 19 01:11:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:11:59.721633 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aa853-82e1-4204-aba9-5825a5537322 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:59.729866 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5e035-70fa-47c4-b992-9ee90addce42 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:59.730166 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5e035-70fa-47c4-b992-9ee90addce42 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:59.730445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5e035-70fa-47c4-b992-9ee90addce42 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:59.731741 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 403/782] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:11:59.736834 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4d78a-592d-4b97-bc96-a061b3ed006b None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:59.737143 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4d78a-592d-4b97-bc96-a061b3ed006b None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:59.737413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4d78a-592d-4b97-bc96-a061b3ed006b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:59.742853 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:59.755113 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-43f4d78a-592d-4b97-bc96-a061b3ed006b None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:11:59.756579 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-43f4d78a-592d-4b97-bc96-a061b3ed006b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:11:59.790639 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:11:59.823032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aa853-82e1-4204-aba9-5825a5537322 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:11:59.823973 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 404/783] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:11:59 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:11:59.856842 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99713d-2081-46ea-b752-d97edc5a0fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:11:59.857464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99713d-2081-46ea-b752-d97edc5a0fe1 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:11:59.857737 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99713d-2081-46ea-b752-d97edc5a0fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:11:59.858002 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99713d-2081-46ea-b752-d97edc5a0fe1 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:11:59.858615 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99713d-2081-46ea-b752-d97edc5a0fe1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:11:59.858908 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99713d-2081-46ea-b752-d97edc5a0fe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:11:59.860260 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99713d-2081-46ea-b752-d97edc5a0fe1 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:11:59.877380 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 380/784] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Aug 19 01:11:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:11:59.882894 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4d78a-592d-4b97-bc96-a061b3ed006b None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:11:59.980621 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4d78a-592d-4b97-bc96-a061b3ed006b None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:00.016066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e78138-683f-401f-b3fd-ecfb648f4caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:00.016667 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e78138-683f-401f-b3fd-ecfb648f4caf None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:00.016974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e78138-683f-401f-b3fd-ecfb648f4caf None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:00.017247 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e78138-683f-401f-b3fd-ecfb648f4caf None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:00.017870 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e78138-683f-401f-b3fd-ecfb648f4caf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:12:00.018170 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e78138-683f-401f-b3fd-ecfb648f4caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:00.019568 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e78138-683f-401f-b3fd-ecfb648f4caf None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:00.024556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 405/785] 10.222.0.82 () {56 vars in 1126 bytes} [Fri Aug 19 01:11:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:12:00.030587 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99713d-2081-46ea-b752-d97edc5a0fe1 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:00.114483 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:00.130426 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99713d-2081-46ea-b752-d97edc5a0fe1 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:00.148022 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e78138-683f-401f-b3fd-ecfb648f4caf None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:00.165759 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21389e5-0832-47f3-8c5a-493b145440c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:00.166950 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21389e5-0832-47f3-8c5a-493b145440c5 None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:00.167227 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21389e5-0832-47f3-8c5a-493b145440c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:00.167499 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21389e5-0832-47f3-8c5a-493b145440c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:00.168158 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21389e5-0832-47f3-8c5a-493b145440c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:00.169561 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21389e5-0832-47f3-8c5a-493b145440c5 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:00.183061 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:00.246826 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e78138-683f-401f-b3fd-ecfb648f4caf None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:00.259618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 381/786] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Aug 19 01:12:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:12:00.289207 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865578b-d28f-4835-b52d-de928668700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:00.289862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865578b-d28f-4835-b52d-de928668700e None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:00.290146 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865578b-d28f-4835-b52d-de928668700e None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:00.290414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865578b-d28f-4835-b52d-de928668700e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:00.291985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865578b-d28f-4835-b52d-de928668700e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:00.293842 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865578b-d28f-4835-b52d-de928668700e None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-7865578b-d28f-4835-b52d-de928668700e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:12:00.308087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:12:00.309228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:12:00.309228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:12:00.309228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:12:00.309228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:12:00.309228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:12:00.309228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:12:00.309228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:12:00.309228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:12:00.309228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:12:00.309228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:12:00.309228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:12:00.309228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:12:00.309228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:12:00.309228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:12:00.309228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:12:00.309228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:12:00.310098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:12:00.310098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:12:00.310098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:12:00.310098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:12:00.310098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:12:00.310098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:12:00.310098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:12:00.310098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:12:00.310098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:12:00.310098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:12:00.310098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:12:00.310098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:12:00.310098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 01:12:00.310098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:12:00.310098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 406/787] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:12:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:12:00.315639 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21389e5-0832-47f3-8c5a-493b145440c5 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:00.428728 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21389e5-0832-47f3-8c5a-493b145440c5 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:00.467017 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd251bd-49b9-4826-88e1-39bb5d7a5cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:00.467631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd251bd-49b9-4826-88e1-39bb5d7a5cb9 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:00.467913 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd251bd-49b9-4826-88e1-39bb5d7a5cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:00.468178 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd251bd-49b9-4826-88e1-39bb5d7a5cb9 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:00.468804 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd251bd-49b9-4826-88e1-39bb5d7a5cb9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:12:00.469132 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd251bd-49b9-4826-88e1-39bb5d7a5cb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:00.470502 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd251bd-49b9-4826-88e1-39bb5d7a5cb9 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:00.475417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 382/788] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:12:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:12:00.481896 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865578b-d28f-4835-b52d-de928668700e None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:00.587074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:00.593737 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865578b-d28f-4835-b52d-de928668700e None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:00.626947 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d183e44-c1e4-43a9-8ff3-62d1e2ee6c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:00.627549 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d183e44-c1e4-43a9-8ff3-62d1e2ee6c9b None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:00.627824 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d183e44-c1e4-43a9-8ff3-62d1e2ee6c9b None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:00.628090 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d183e44-c1e4-43a9-8ff3-62d1e2ee6c9b None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:00.628708 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d183e44-c1e4-43a9-8ff3-62d1e2ee6c9b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:12:00.629033 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d183e44-c1e4-43a9-8ff3-62d1e2ee6c9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:00.630678 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d183e44-c1e4-43a9-8ff3-62d1e2ee6c9b None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:00.635793 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 407/789] 10.222.0.82 () {56 vars in 1114 bytes} [Fri Aug 19 01:12:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:12:00.641537 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd251bd-49b9-4826-88e1-39bb5d7a5cb9 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:00.645303 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:00.742228 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd251bd-49b9-4826-88e1-39bb5d7a5cb9 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:00.781170 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8772176-9827-4b32-bf61-5adc6a841b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:00.781777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8772176-9827-4b32-bf61-5adc6a841b2b None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:00.782054 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8772176-9827-4b32-bf61-5adc6a841b2b None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:00.782324 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8772176-9827-4b32-bf61-5adc6a841b2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:00.782990 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8772176-9827-4b32-bf61-5adc6a841b2b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:00.784364 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8772176-9827-4b32-bf61-5adc6a841b2b None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:00.873022 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 383/790] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Aug 19 01:12:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:12:02.466963 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74183a-4f92-4241-8f78-0f993ee00077 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:02.467539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74183a-4f92-4241-8f78-0f993ee00077 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:02.467539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74183a-4f92-4241-8f78-0f993ee00077 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:02.468841 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 408/791] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:12:02.473992 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91699a4-6514-4da4-9112-2a98dd1cad4a None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:02.474426 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91699a4-6514-4da4-9112-2a98dd1cad4a None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:02.474530 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91699a4-6514-4da4-9112-2a98dd1cad4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:02.493379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-d91699a4-6514-4da4-9112-2a98dd1cad4a None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:12:02.495618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-d91699a4-6514-4da4-9112-2a98dd1cad4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:12:02.552457 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:02.569784 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 384/792] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:12:02 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:12:02.906160 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74183a-4f92-4241-8f78-0f993ee00077 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:03.016633 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74183a-4f92-4241-8f78-0f993ee00077 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:03.050139 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676a36f-2e73-4fc1-9394-8dcd637573ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:03.050767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676a36f-2e73-4fc1-9394-8dcd637573ab None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:03.051049 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676a36f-2e73-4fc1-9394-8dcd637573ab None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:03.051327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676a36f-2e73-4fc1-9394-8dcd637573ab None admin] PATH_INFO: `/v3/services/compute` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:03.051897 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676a36f-2e73-4fc1-9394-8dcd637573ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:03.053512 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676a36f-2e73-4fc1-9394-8dcd637573ab None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-e676a36f-2e73-4fc1-9394-8dcd637573ab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:12:03.062104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:12:03.063073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:12:03.063073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:12:03.063073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:12:03.063073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:12:03.063073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:12:03.063073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:12:03.063073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:12:03.063073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:12:03.063073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:12:03.063073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:12:03.063073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:12:03.063073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:12:03.063073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:12:03.063073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:12:03.063073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:12:03.063073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:12:03.064635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:12:03.064635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:12:03.064635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:12:03.064635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:12:03.064635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:12:03.064635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:12:03.064635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:12:03.064635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:12:03.064635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:12:03.064635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:12:03.064635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:12:03.064635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:12:03.064635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 01:12:03.064635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:12:03.064635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 409/793] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:12:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:12:03.069039 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91699a4-6514-4da4-9112-2a98dd1cad4a None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:03.091060 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d55d3a-5d09-47fb-9fd4-f21774970a24 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:03.091369 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d55d3a-5d09-47fb-9fd4-f21774970a24 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:03.091613 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d55d3a-5d09-47fb-9fd4-f21774970a24 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:03.092968 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 410/794] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:12:03.098106 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb7906-9620-462a-b5e6-041a59911d22 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:03.098388 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb7906-9620-462a-b5e6-041a59911d22 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:03.098665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb7906-9620-462a-b5e6-041a59911d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:03.116625 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-a3cb7906-9620-462a-b5e6-041a59911d22 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:12:03.117909 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-a3cb7906-9620-462a-b5e6-041a59911d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:12:03.135228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:03.170473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91699a4-6514-4da4-9112-2a98dd1cad4a None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:03.185498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 411/795] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:12:03 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 01:12:03.204032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83a7a6-f1cb-4478-80ba-45f1e3b895b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:03.204630 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83a7a6-f1cb-4478-80ba-45f1e3b895b1 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:03.204942 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83a7a6-f1cb-4478-80ba-45f1e3b895b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:03.205213 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83a7a6-f1cb-4478-80ba-45f1e3b895b1 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:03.205833 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83a7a6-f1cb-4478-80ba-45f1e3b895b1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:12:03.206134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83a7a6-f1cb-4478-80ba-45f1e3b895b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:03.207505 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83a7a6-f1cb-4478-80ba-45f1e3b895b1 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:03.212028 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 385/796] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Aug 19 01:12:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:12:03.218293 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb7906-9620-462a-b5e6-041a59911d22 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:03.314368 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb7906-9620-462a-b5e6-041a59911d22 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:03.348332 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c86465-bb9e-467b-bf3a-d61d0646f13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:03.348956 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c86465-bb9e-467b-bf3a-d61d0646f13c None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:03.349235 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c86465-bb9e-467b-bf3a-d61d0646f13c None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:03.349505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c86465-bb9e-467b-bf3a-d61d0646f13c None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:03.350124 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c86465-bb9e-467b-bf3a-d61d0646f13c None admin] RBAC: Adding query filter params (type=compute) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:12:03.350424 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c86465-bb9e-467b-bf3a-d61d0646f13c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:03.351775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c86465-bb9e-467b-bf3a-d61d0646f13c None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:03.356378 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 412/797] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Aug 19 01:12:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:12:03.517001 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83a7a6-f1cb-4478-80ba-45f1e3b895b1 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:03.571683 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:03.621982 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83a7a6-f1cb-4478-80ba-45f1e3b895b1 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:03.655509 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6ac5a-d6df-4bd8-bef3-e2af5181b9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:03.656095 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6ac5a-d6df-4bd8-bef3-e2af5181b9e4 None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:03.656368 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6ac5a-d6df-4bd8-bef3-e2af5181b9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:03.656633 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6ac5a-d6df-4bd8-bef3-e2af5181b9e4 None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:03.657293 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6ac5a-d6df-4bd8-bef3-e2af5181b9e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:03.658709 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6ac5a-d6df-4bd8-bef3-e2af5181b9e4 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:03.661281 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: WARNING keystone.server.flask.common [None req-a5a6ac5a-d6df-4bd8-bef3-e2af5181b9e4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 01:12:03.706183 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.sql.core [None req-a5a6ac5a-d6df-4bd8-bef3-e2af5181b9e4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 01:12:03.706183 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 01:12:03.706183 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [parameters: {'id': 'f9f7c9a54a854d8db7e5efbb4ed2de3c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 01:12:03.706183 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88725) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 01:12:03.722740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-a5a6ac5a-d6df-4bd8-bef3-e2af5181b9e4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9f7c9a54a854d8db7e5efbb4ed2de3c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9f7c9a54a854d8db7e5efbb4ed2de3c. Aug 19 01:12:03.722740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:03.722740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 01:12:03.722740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 01:12:03.722740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 01:12:03.722740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 01:12:03.722740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 01:12:03.722740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 01:12:03.722740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 01:12:03.722740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application conn.query(q) Aug 19 01:12:03.722740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 01:12:03.722740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 01:12:03.722740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application result.read() Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 19 01:12:03.723631 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application next(self.gen) Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application yield resource Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application next(self.gen) Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise self.value Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application session.commit() Aug 19 01:12:03.724647 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self.session.flush() Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application compat.raise_( Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 01:12:03.725618 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 01:12:03.726538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 01:12:03.726538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 01:12:03.726538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 01:12:03.726538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 01:12:03.726538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 01:12:03.726538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 01:12:03.726538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 01:12:03.726538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 01:12:03.726538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 01:12:03.726538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 01:12:03.726538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 01:12:03.726538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 01:12:03.726538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 01:12:03.726538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 01:12:03.726538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application conn.query(q) Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application result.read() Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 01:12:03.727407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 01:12:03.728313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 01:12:03.728313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 01:12:03.728313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 01:12:03.728313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 01:12:03.728313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 01:12:03.728313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 01:12:03.728313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 01:12:03.728313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 01:12:03.728313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [parameters: {'id': 'f9f7c9a54a854d8db7e5efbb4ed2de3c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 01:12:03.728313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 01:12:03.728313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:12:03.728313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:12:03.728313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:12:03.728313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:03.728313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:12:03.729958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:12:03.731065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:12:03.731065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 19 01:12:03.731065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 19 01:12:03.731065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:12:03.731065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:12:03.731065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 19 01:12:03.731065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 19 01:12:03.731065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9f7c9a54a854d8db7e5efbb4ed2de3c. Aug 19 01:12:03.731065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:12:03.731065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 386/798] 10.222.0.82 () {60 vars in 1140 bytes} [Fri Aug 19 01:12:03 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:12:03.732579 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c86465-bb9e-467b-bf3a-d61d0646f13c None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:03.753381 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:03.834756 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c86465-bb9e-467b-bf3a-d61d0646f13c None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:03.868667 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c677afd-ff05-435e-94f6-198b21fe51b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:03.869931 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c677afd-ff05-435e-94f6-198b21fe51b6 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:03.870210 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c677afd-ff05-435e-94f6-198b21fe51b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:03.870482 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c677afd-ff05-435e-94f6-198b21fe51b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:03.877085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c677afd-ff05-435e-94f6-198b21fe51b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:03.878516 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c677afd-ff05-435e-94f6-198b21fe51b6 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:03.890008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-9c677afd-ff05-435e-94f6-198b21fe51b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:12:03.890008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:03.890008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:12:03.890008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:12:03.890008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:12:03.890008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:12:03.890008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:12:03.890008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:12:03.890008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:12:03.890008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:12:03.890008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:12:03.890008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:12:03.890008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:12:03.890008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:12:03.890008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:12:03.890937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:12:03.891836 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:12:03.891836 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:12:03.891836 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:12:03.891836 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:12:03.891836 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:12:03.891836 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:12:03.891836 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:12:03.891836 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:12:03.893166 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 413/799] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:12:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:12:03.897583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6ac5a-d6df-4bd8-bef3-e2af5181b9e4 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:04.001114 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6ac5a-d6df-4bd8-bef3-e2af5181b9e4 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:04.008426 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:04.035301 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4acc5-d9d5-4342-bf36-9d41e639ec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:04.035884 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4acc5-d9d5-4342-bf36-9d41e639ec37 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:04.036193 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4acc5-d9d5-4342-bf36-9d41e639ec37 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:04.036470 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4acc5-d9d5-4342-bf36-9d41e639ec37 None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:04.037416 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4acc5-d9d5-4342-bf36-9d41e639ec37 None admin] RBAC: Adding query filter params (name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:12:04.037948 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4acc5-d9d5-4342-bf36-9d41e639ec37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:04.039739 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4acc5-d9d5-4342-bf36-9d41e639ec37 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:04.060449 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 387/800] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Aug 19 01:12:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:12:05.552635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23724f21-313a-410e-b9e3-59eaccab703a None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:05.553066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23724f21-313a-410e-b9e3-59eaccab703a None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:05.553216 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23724f21-313a-410e-b9e3-59eaccab703a None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:05.554542 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 414/801] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:12:05.560404 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81068a2e-135d-4d12-b0c4-0458e56e9f49 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:05.560824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81068a2e-135d-4d12-b0c4-0458e56e9f49 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:05.560986 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81068a2e-135d-4d12-b0c4-0458e56e9f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:05.580219 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-81068a2e-135d-4d12-b0c4-0458e56e9f49 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:12:05.581741 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-81068a2e-135d-4d12-b0c4-0458e56e9f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:12:05.649771 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 388/802] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:12:05 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:12:05.988161 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23724f21-313a-410e-b9e3-59eaccab703a None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:06.064537 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:06.087489 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23724f21-313a-410e-b9e3-59eaccab703a None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:06.121616 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48081246-e76f-4582-b32d-374bc8beb9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:06.122247 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081246-e76f-4582-b32d-374bc8beb9d9 None admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:06.122531 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081246-e76f-4582-b32d-374bc8beb9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:06.122807 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081246-e76f-4582-b32d-374bc8beb9d9 None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:06.123503 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48081246-e76f-4582-b32d-374bc8beb9d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:06.124955 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48081246-e76f-4582-b32d-374bc8beb9d9 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:06.215422 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 415/803] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Aug 19 01:12:05 2022] POST /identity/v3/services => generated 242 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:12:06.294274 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589f72c-322a-4e26-b34f-366618b9ba11 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:06.294472 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589f72c-322a-4e26-b34f-366618b9ba11 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:06.294730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589f72c-322a-4e26-b34f-366618b9ba11 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:06.296096 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 389/804] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:12:06.301895 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4feb476-f4ac-444f-bfd4-03f0d639e274 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:06.302189 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4feb476-f4ac-444f-bfd4-03f0d639e274 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:06.302467 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4feb476-f4ac-444f-bfd4-03f0d639e274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:06.321748 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-d4feb476-f4ac-444f-bfd4-03f0d639e274 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:12:06.323544 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-d4feb476-f4ac-444f-bfd4-03f0d639e274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:12:06.399470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 416/805] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:12:06 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:12:06.728994 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589f72c-322a-4e26-b34f-366618b9ba11 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:06.829232 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:06.835783 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589f72c-322a-4e26-b34f-366618b9ba11 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:06.870696 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271013f-bd83-40d7-9415-f06dd98fad25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:06.871287 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271013f-bd83-40d7-9415-f06dd98fad25 None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:06.871565 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271013f-bd83-40d7-9415-f06dd98fad25 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:06.871832 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271013f-bd83-40d7-9415-f06dd98fad25 None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:06.872448 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271013f-bd83-40d7-9415-f06dd98fad25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:06.873913 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271013f-bd83-40d7-9415-f06dd98fad25 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:06.933945 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.sql.core [None req-2271013f-bd83-40d7-9415-f06dd98fad25 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 01:12:06.933945 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 01:12:06.933945 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [parameters: {'user_id': '9e4a371d27004e10813ebdfbf53411f3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 01:12:06.933945 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88725) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 01:12:06.940583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-2271013f-bd83-40d7-9415-f06dd98fad25 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 01:12:06.940583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:06.940583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 01:12:06.940583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 01:12:06.940583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 01:12:06.940583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 01:12:06.940583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 01:12:06.940583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 01:12:06.940583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 01:12:06.940583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application conn.query(q) Aug 19 01:12:06.940583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 01:12:06.940583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 01:12:06.940583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 01:12:06.940583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application result.read() Aug 19 01:12:06.940583 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 01:12:06.941497 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application next(self.gen) Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application yield resource Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application next(self.gen) Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise self.value Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application session.commit() Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 01:12:06.942467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self.session.flush() Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application compat.raise_( Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 01:12:06.943339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 01:12:06.944211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 01:12:06.944211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 01:12:06.944211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 19 01:12:06.944211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 19 01:12:06.944211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 01:12:06.944211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 01:12:06.944211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 01:12:06.944211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 01:12:06.944211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 01:12:06.944211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 01:12:06.944211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 01:12:06.944211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 01:12:06.944211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 01:12:06.944211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 01:12:06.944211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 01:12:06.944211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception Aug 19 01:12:06.945123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 01:12:06.945123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 01:12:06.945123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 01:12:06.945123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 01:12:06.945123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 01:12:06.945123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 01:12:06.945123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 01:12:06.945123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application conn.query(q) Aug 19 01:12:06.945123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 01:12:06.945123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 01:12:06.945123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 01:12:06.945123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application result.read() Aug 19 01:12:06.945123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 01:12:06.945123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 01:12:06.945123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 01:12:06.945123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 01:12:06.945940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 01:12:06.945940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 01:12:06.945940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 01:12:06.945940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 01:12:06.945940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 01:12:06.945940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 01:12:06.945940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [parameters: {'user_id': '9e4a371d27004e10813ebdfbf53411f3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 01:12:06.945940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 01:12:06.945940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:12:06.945940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:12:06.945940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:12:06.945940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:06.945940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:12:06.945940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:12:06.945940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 19 01:12:06.948641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 19 01:12:06.950753 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 19 01:12:06.950753 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 19 01:12:06.950753 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 01:12:06.950753 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 01:12:06.950753 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 01:12:06.950753 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:12:06.950753 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 390/806] 10.222.0.82 () {60 vars in 1131 bytes} [Fri Aug 19 01:12:06 2022] POST /identity/v3/users => generated 160 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:12:06.951334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4feb476-f4ac-444f-bfd4-03f0d639e274 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:07.007854 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:07.045310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4feb476-f4ac-444f-bfd4-03f0d639e274 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:07.078833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de371070-0be8-4cc4-8e7d-291229e2156e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:07.079832 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de371070-0be8-4cc4-8e7d-291229e2156e None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:07.080067 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de371070-0be8-4cc4-8e7d-291229e2156e None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:07.080332 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de371070-0be8-4cc4-8e7d-291229e2156e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:07.090965 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de371070-0be8-4cc4-8e7d-291229e2156e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:07.092437 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de371070-0be8-4cc4-8e7d-291229e2156e None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:07.106839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-de371070-0be8-4cc4-8e7d-291229e2156e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 01:12:07.106839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:07.106839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:12:07.106839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:12:07.106839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:12:07.106839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:12:07.106839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:12:07.106839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:12:07.106839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:12:07.106839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:12:07.106839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:12:07.106839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:12:07.106839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:12:07.106839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:12:07.106839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:12:07.106839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:12:07.107835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:12:07.108881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:12:07.108881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:12:07.108881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:12:07.108881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:12:07.108881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:12:07.108881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:12:07.108881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:12:07.108881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:12:07.108881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 01:12:07.108881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:12:07.108881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 417/807] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:12:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:12:07.113967 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271013f-bd83-40d7-9415-f06dd98fad25 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:07.218585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271013f-bd83-40d7-9415-f06dd98fad25 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:07.254029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04ec16-0b77-464e-9de4-5b5123ea30fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:07.254625 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04ec16-0b77-464e-9de4-5b5123ea30fd None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:07.254896 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04ec16-0b77-464e-9de4-5b5123ea30fd None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:07.255161 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04ec16-0b77-464e-9de4-5b5123ea30fd None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:07.255839 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04ec16-0b77-464e-9de4-5b5123ea30fd None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:12:07.256132 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04ec16-0b77-464e-9de4-5b5123ea30fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:07.257780 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04ec16-0b77-464e-9de4-5b5123ea30fd None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:07.295731 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 391/808] 10.222.0.82 () {56 vars in 1101 bytes} [Fri Aug 19 01:12:07 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:12:08.470359 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503c785-7239-4451-a8f9-855f2d0da83a None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:08.470885 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503c785-7239-4451-a8f9-855f2d0da83a None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:08.470885 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503c785-7239-4451-a8f9-855f2d0da83a None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:08.472211 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 418/809] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:12:08.477382 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96b1a5-3a17-4ac4-a279-161b4f4cbb6e None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:08.477812 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96b1a5-3a17-4ac4-a279-161b4f4cbb6e None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:08.477917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96b1a5-3a17-4ac4-a279-161b4f4cbb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:08.497229 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-be96b1a5-3a17-4ac4-a279-161b4f4cbb6e None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:12:08.498867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-be96b1a5-3a17-4ac4-a279-161b4f4cbb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:12:08.509579 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:08.567219 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 392/810] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:12:08 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:12:08.899888 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503c785-7239-4451-a8f9-855f2d0da83a None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:09.000350 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503c785-7239-4451-a8f9-855f2d0da83a None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:09.022103 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:09.034228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133d5d9-a562-4716-8a12-99847c3a11e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:09.034848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133d5d9-a562-4716-8a12-99847c3a11e0 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:09.035128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133d5d9-a562-4716-8a12-99847c3a11e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:09.035396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133d5d9-a562-4716-8a12-99847c3a11e0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:09.035967 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133d5d9-a562-4716-8a12-99847c3a11e0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:09.037363 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133d5d9-a562-4716-8a12-99847c3a11e0 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-e133d5d9-a562-4716-8a12-99847c3a11e0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:12:09.046445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:12:09.051557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:12:09.051557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:12:09.051557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:12:09.051557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:12:09.051557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:12:09.051557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:12:09.051557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:12:09.051557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:12:09.051557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:12:09.051557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:12:09.051557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:12:09.051557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:12:09.051557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:12:09.051557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:12:09.051557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:12:09.051557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:12:09.052582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:12:09.052582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:12:09.052582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:12:09.052582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:12:09.052582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:12:09.052582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:12:09.052582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:12:09.052582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:12:09.052582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:12:09.052582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:12:09.052582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:12:09.052582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:12:09.052582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 01:12:09.052582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:12:09.052582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 419/811] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:12:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:12:09.053797 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96b1a5-3a17-4ac4-a279-161b4f4cbb6e None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:09.152938 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96b1a5-3a17-4ac4-a279-161b4f4cbb6e None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:09.185145 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d24b55-cbbc-4f86-9a63-2216aca7b8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:09.185746 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d24b55-cbbc-4f86-9a63-2216aca7b8ed None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:09.186024 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d24b55-cbbc-4f86-9a63-2216aca7b8ed None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:09.186295 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d24b55-cbbc-4f86-9a63-2216aca7b8ed None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:09.186913 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d24b55-cbbc-4f86-9a63-2216aca7b8ed None admin] RBAC: Adding query filter params (name=compute) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:12:09.187213 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d24b55-cbbc-4f86-9a63-2216aca7b8ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:09.188581 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d24b55-cbbc-4f86-9a63-2216aca7b8ed None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:09.193289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 393/812] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Aug 19 01:12:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:12:09.199708 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133d5d9-a562-4716-8a12-99847c3a11e0 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:09.296247 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133d5d9-a562-4716-8a12-99847c3a11e0 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:09.329530 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce2238-087b-473e-95b3-d1817e8d21f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:09.330117 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce2238-087b-473e-95b3-d1817e8d21f7 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:09.330396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce2238-087b-473e-95b3-d1817e8d21f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:09.330667 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce2238-087b-473e-95b3-d1817e8d21f7 None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:09.331285 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce2238-087b-473e-95b3-d1817e8d21f7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:12:09.331587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce2238-087b-473e-95b3-d1817e8d21f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:09.332968 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce2238-087b-473e-95b3-d1817e8d21f7 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:09.337545 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 420/813] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Aug 19 01:12:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:12:09.343422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d24b55-cbbc-4f86-9a63-2216aca7b8ed None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:09.355748 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:09.442348 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d24b55-cbbc-4f86-9a63-2216aca7b8ed None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:09.475116 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd32d08-dd85-4ee0-931c-24a841eb161e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:09.475699 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd32d08-dd85-4ee0-931c-24a841eb161e None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:09.475978 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd32d08-dd85-4ee0-931c-24a841eb161e None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:09.476242 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd32d08-dd85-4ee0-931c-24a841eb161e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:09.476946 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd32d08-dd85-4ee0-931c-24a841eb161e None admin] RBAC: Adding query filter params (interface=public, service_id=26233380e8c9421a8200cdfd41ca0f40, region_id=RegionOne) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:12:09.477246 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd32d08-dd85-4ee0-931c-24a841eb161e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:09.478705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd32d08-dd85-4ee0-931c-24a841eb161e None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:09.483553 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 394/814] 10.222.0.82 () {56 vars in 1251 bytes} [Fri Aug 19 01:12:09 2022] GET /identity/v3/endpoints?service_id=26233380e8c9421a8200cdfd41ca0f40&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:12:09.489080 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce2238-087b-473e-95b3-d1817e8d21f7 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:09.537869 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:09.587086 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce2238-087b-473e-95b3-d1817e8d21f7 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:09.620044 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ced511-80fc-4db6-af50-1e7c73658d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:09.620625 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ced511-80fc-4db6-af50-1e7c73658d0b None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:09.620928 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ced511-80fc-4db6-af50-1e7c73658d0b None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:09.621198 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ced511-80fc-4db6-af50-1e7c73658d0b None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:09.621786 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ced511-80fc-4db6-af50-1e7c73658d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:09.623128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ced511-80fc-4db6-af50-1e7c73658d0b None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:09.629072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 421/815] 10.222.0.82 () {56 vars in 1087 bytes} [Fri Aug 19 01:12:09 2022] GET /identity/v3/services => generated 1728 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:12:11.805795 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01ae5b-c966-4fd0-807e-1b248e746ed9 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:11.806329 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01ae5b-c966-4fd0-807e-1b248e746ed9 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:11.806329 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01ae5b-c966-4fd0-807e-1b248e746ed9 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:11.807586 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 395/816] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:12:11.812622 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cff861-3467-4e36-bb76-a8c5a537a906 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:11.813038 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cff861-3467-4e36-bb76-a8c5a537a906 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:11.813189 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cff861-3467-4e36-bb76-a8c5a537a906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:11.831260 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-67cff861-3467-4e36-bb76-a8c5a537a906 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:12:11.832484 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-67cff861-3467-4e36-bb76-a8c5a537a906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:12:11.898677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 422/817] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:12:11 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:12:12.233698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01ae5b-c966-4fd0-807e-1b248e746ed9 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:12.309307 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:12.335424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01ae5b-c966-4fd0-807e-1b248e746ed9 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:12.369893 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36452be-b4ee-4608-9193-a2812ee184bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:12.370486 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36452be-b4ee-4608-9193-a2812ee184bf None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:12.370756 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36452be-b4ee-4608-9193-a2812ee184bf None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:12.371020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36452be-b4ee-4608-9193-a2812ee184bf None admin] PATH_INFO: `/v3/services/compute` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:12.371584 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36452be-b4ee-4608-9193-a2812ee184bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:12.372958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36452be-b4ee-4608-9193-a2812ee184bf None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-c36452be-b4ee-4608-9193-a2812ee184bf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:12:12.381388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:12:12.382514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:12:12.382514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:12:12.382514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:12:12.382514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:12:12.382514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:12:12.382514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:12:12.382514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:12:12.382514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:12:12.382514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:12:12.382514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:12:12.382514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:12:12.382514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:12:12.382514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:12:12.382514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:12:12.382514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:12:12.382514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:12:12.383663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:12:12.383663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:12:12.383663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:12:12.383663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:12:12.383663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:12:12.383663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:12:12.383663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:12:12.383663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:12:12.383663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:12:12.383663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:12:12.383663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:12:12.383663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:12:12.383663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 01:12:12.383663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:12:12.383663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 396/818] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:12:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:12:12.389125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cff861-3467-4e36-bb76-a8c5a537a906 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:12.432686 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:12.483557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cff861-3467-4e36-bb76-a8c5a537a906 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:12.516702 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f2e1c-b00d-42a9-8492-965f7e8d99d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:12.517261 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f2e1c-b00d-42a9-8492-965f7e8d99d6 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:12.517536 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f2e1c-b00d-42a9-8492-965f7e8d99d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:12.517805 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f2e1c-b00d-42a9-8492-965f7e8d99d6 None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:12.518412 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f2e1c-b00d-42a9-8492-965f7e8d99d6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:12:12.518707 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f2e1c-b00d-42a9-8492-965f7e8d99d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:12.520066 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f2e1c-b00d-42a9-8492-965f7e8d99d6 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:12.524834 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 423/819] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Aug 19 01:12:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:12:12.530462 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36452be-b4ee-4608-9193-a2812ee184bf None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:12.630830 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36452be-b4ee-4608-9193-a2812ee184bf None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:12.663856 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2a63b-7a67-4667-90b2-4586ef401e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:12.664454 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2a63b-7a67-4667-90b2-4586ef401e24 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:12.664730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2a63b-7a67-4667-90b2-4586ef401e24 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:12.665036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2a63b-7a67-4667-90b2-4586ef401e24 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:12.666171 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2a63b-7a67-4667-90b2-4586ef401e24 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:12:12.666473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2a63b-7a67-4667-90b2-4586ef401e24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:12.667847 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2a63b-7a67-4667-90b2-4586ef401e24 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:12.672474 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 397/820] 10.222.0.82 () {56 vars in 1112 bytes} [Fri Aug 19 01:12:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:12:12.678480 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f2e1c-b00d-42a9-8492-965f7e8d99d6 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:12:12.773889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f2e1c-b00d-42a9-8492-965f7e8d99d6 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:12:12.782590 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:12.807590 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea338d56-b42a-4ba2-9102-f4a4b9f38736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:12:12.808189 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea338d56-b42a-4ba2-9102-f4a4b9f38736 None admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:12:12.808471 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea338d56-b42a-4ba2-9102-f4a4b9f38736 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:12:12.808742 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea338d56-b42a-4ba2-9102-f4a4b9f38736 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:12:12.809439 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea338d56-b42a-4ba2-9102-f4a4b9f38736 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:12:12.810814 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea338d56-b42a-4ba2-9102-f4a4b9f38736 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:12:12.973012 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 424/821] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Aug 19 01:12:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:12:22.670100 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:12:22.968704 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=17,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:32.146589 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca70c39-cfde-4ecc-bdb2-49bb63865452 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:32.147538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca70c39-cfde-4ecc-bdb2-49bb63865452 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:32.147538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca70c39-cfde-4ecc-bdb2-49bb63865452 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:32.149521 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 398/822] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:13:32.154720 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47a87c-ff88-486e-aa04-637c4ab1f112 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:32.155145 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47a87c-ff88-486e-aa04-637c4ab1f112 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:32.155268 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47a87c-ff88-486e-aa04-637c4ab1f112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:32.174278 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-1c47a87c-ff88-486e-aa04-637c4ab1f112 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:13:32.175475 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-1c47a87c-ff88-486e-aa04-637c4ab1f112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:13:32.249472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 425/823] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:13:32 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:13:32.583258 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca70c39-cfde-4ecc-bdb2-49bb63865452 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:32.686003 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca70c39-cfde-4ecc-bdb2-49bb63865452 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:32.719940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313326d-068a-4233-9af3-58711f378946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:32.720557 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313326d-068a-4233-9af3-58711f378946 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:32.720837 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313326d-068a-4233-9af3-58711f378946 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:32.721140 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313326d-068a-4233-9af3-58711f378946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:32.731313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313326d-068a-4233-9af3-58711f378946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:32.732810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313326d-068a-4233-9af3-58711f378946 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:32.747104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-a313326d-068a-4233-9af3-58711f378946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:32.747104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:32.747104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:32.747104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:32.747104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:32.747104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:32.747104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:32.747104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:32.747104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:32.747104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:32.747104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:32.747104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:32.747104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:13:32.747104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:13:32.747104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:13:32.747104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:32.748289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:13:32.749290 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:13:32.749290 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:32.749290 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:13:32.749290 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 399/824] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:32.755080 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47a87c-ff88-486e-aa04-637c4ab1f112 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:32.852635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47a87c-ff88-486e-aa04-637c4ab1f112 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:32.877531 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:32.885842 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566414a-e294-44b2-983a-02b8285b41be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:32.886459 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566414a-e294-44b2-983a-02b8285b41be None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:32.886730 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566414a-e294-44b2-983a-02b8285b41be None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:32.886995 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566414a-e294-44b2-983a-02b8285b41be None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:32.887614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566414a-e294-44b2-983a-02b8285b41be None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:32.887907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566414a-e294-44b2-983a-02b8285b41be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:32.889295 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566414a-e294-44b2-983a-02b8285b41be None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:32.900985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 426/825] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:32.906824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313326d-068a-4233-9af3-58711f378946 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:32.960092 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:33.007121 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313326d-068a-4233-9af3-58711f378946 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:33.039469 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf569e2-1b10-4352-bcca-c87795973455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:33.040065 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf569e2-1b10-4352-bcca-c87795973455 None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:33.040338 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf569e2-1b10-4352-bcca-c87795973455 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:33.040604 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf569e2-1b10-4352-bcca-c87795973455 None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:33.041292 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf569e2-1b10-4352-bcca-c87795973455 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:33.042712 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf569e2-1b10-4352-bcca-c87795973455 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:33.122239 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 400/826] 10.222.0.82 () {60 vars in 1132 bytes} [Fri Aug 19 01:13:32 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:13:35.327771 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f044f79-bc77-4c46-a229-199d3619d503 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:35.328331 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f044f79-bc77-4c46-a229-199d3619d503 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:35.328331 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f044f79-bc77-4c46-a229-199d3619d503 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:35.329666 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 427/827] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:13:35.335488 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd626f6-cc9c-43e8-8ecc-56ed4e4f2f2c None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:35.335948 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd626f6-cc9c-43e8-8ecc-56ed4e4f2f2c None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:35.336036 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd626f6-cc9c-43e8-8ecc-56ed4e4f2f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:35.354612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-9dd626f6-cc9c-43e8-8ecc-56ed4e4f2f2c None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:13:35.355882 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-9dd626f6-cc9c-43e8-8ecc-56ed4e4f2f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:13:35.423487 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 401/828] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:13:35 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:13:35.759233 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f044f79-bc77-4c46-a229-199d3619d503 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:35.860235 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f044f79-bc77-4c46-a229-199d3619d503 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:35.892686 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47346e9-7a24-4660-b22b-e5ba106731aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:35.893351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47346e9-7a24-4660-b22b-e5ba106731aa None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:35.894218 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47346e9-7a24-4660-b22b-e5ba106731aa None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:35.894557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47346e9-7a24-4660-b22b-e5ba106731aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:35.905422 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47346e9-7a24-4660-b22b-e5ba106731aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:13:35.910700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-a47346e9-7a24-4660-b22b-e5ba106731aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:13:35.910700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:35.910700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:35.910700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:35.910700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:35.910700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:35.910700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:35.910700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:35.910700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:35.910700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:35.910700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:35.910700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:35.910700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:13:35.910700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:13:35.910700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:13:35.910700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:13:35.911913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:13:35.911913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:13:35.911913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:13:35.911913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:13:35.911913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:35.911913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:35.911913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:35.911913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:35.911913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:35.911913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:35.911913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:35.911913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:35.911913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:35.911913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:35.911913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:35.911913 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:35.912996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:35.912996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:35.912996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:35.912996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:35.912996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:13:35.912996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:13:35.912996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:13:35.912996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:13:35.912996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:13:35.912996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:13:35.912996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:13:35.912996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:13:35.912996 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 428/829] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:13:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:35.918103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd626f6-cc9c-43e8-8ecc-56ed4e4f2f2c None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:35.965401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:36.025288 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd626f6-cc9c-43e8-8ecc-56ed4e4f2f2c None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:36.058006 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0571f6-9749-487a-9ea1-54c4a813ad66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:36.058627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0571f6-9749-487a-9ea1-54c4a813ad66 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:36.058890 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0571f6-9749-487a-9ea1-54c4a813ad66 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:36.059162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0571f6-9749-487a-9ea1-54c4a813ad66 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:36.059817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0571f6-9749-487a-9ea1-54c4a813ad66 None admin] RBAC: Adding query filter params (name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:36.060117 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0571f6-9749-487a-9ea1-54c4a813ad66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:36.061514 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0571f6-9749-487a-9ea1-54c4a813ad66 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:36.070266 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 402/830] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Aug 19 01:13:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:36.076229 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47346e9-7a24-4660-b22b-e5ba106731aa None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:36.122342 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:36.176542 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47346e9-7a24-4660-b22b-e5ba106731aa None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:36.210122 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3ad3d-057f-4dbc-b7ee-204387749b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:36.210767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3ad3d-057f-4dbc-b7ee-204387749b94 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:36.211048 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3ad3d-057f-4dbc-b7ee-204387749b94 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:36.211316 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3ad3d-057f-4dbc-b7ee-204387749b94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:36.222401 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3ad3d-057f-4dbc-b7ee-204387749b94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:36.223848 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3ad3d-057f-4dbc-b7ee-204387749b94 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:36.239519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-a0a3ad3d-057f-4dbc-b7ee-204387749b94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:36.239519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:36.239519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:36.239519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:36.239519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:36.239519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:36.239519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:36.239519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:36.239519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:36.239519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:36.239519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:36.239519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:36.239519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:13:36.239519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:13:36.239519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:13:36.239519 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:36.240517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:13:36.241850 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:13:36.241850 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:36.241850 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:13:36.241850 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 429/831] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:36.246455 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0571f6-9749-487a-9ea1-54c4a813ad66 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:36.344124 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:36.346946 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0571f6-9749-487a-9ea1-54c4a813ad66 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:36.380145 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6d244-4a94-4f29-802e-054b1273406e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:36.380741 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6d244-4a94-4f29-802e-054b1273406e None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:36.381053 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6d244-4a94-4f29-802e-054b1273406e None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:36.381325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6d244-4a94-4f29-802e-054b1273406e None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:36.381954 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6d244-4a94-4f29-802e-054b1273406e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:36.382256 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6d244-4a94-4f29-802e-054b1273406e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:36.383624 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6d244-4a94-4f29-802e-054b1273406e None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:36.395549 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 403/832] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:36.401589 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3ad3d-057f-4dbc-b7ee-204387749b94 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:36.498416 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:36.502149 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3ad3d-057f-4dbc-b7ee-204387749b94 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:36.539074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc1ccd-df33-4ff0-9ce7-145b59023903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:36.539293 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc1ccd-df33-4ff0-9ce7-145b59023903 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:36.539479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc1ccd-df33-4ff0-9ce7-145b59023903 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:36.539750 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc1ccd-df33-4ff0-9ce7-145b59023903 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:36.548286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc1ccd-df33-4ff0-9ce7-145b59023903 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:36.550427 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc1ccd-df33-4ff0-9ce7-145b59023903 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:36.561986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-76bc1ccd-df33-4ff0-9ce7-145b59023903 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 01:13:36.561986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:36.561986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:36.561986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:36.561986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:36.561986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:36.561986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:36.561986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:36.561986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:36.561986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:36.561986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:36.561986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:36.561986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:13:36.561986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:13:36.561986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:13:36.561986 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:36.563479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:36.564658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:36.564658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:36.564658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:13:36.564658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:13:36.564658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:13:36.564658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:13:36.564658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:13:36.564658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:13:36.564658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 01:13:36.564658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:13:36.564658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 430/833] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:13:36.570133 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6d244-4a94-4f29-802e-054b1273406e None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:36.672969 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6d244-4a94-4f29-802e-054b1273406e None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:36.706787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4e11f-c3e2-4a65-9271-16c8ddb33187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:36.707371 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e11f-c3e2-4a65-9271-16c8ddb33187 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:36.707651 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e11f-c3e2-4a65-9271-16c8ddb33187 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:36.707923 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e11f-c3e2-4a65-9271-16c8ddb33187 None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:36.708643 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4e11f-c3e2-4a65-9271-16c8ddb33187 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:36.708978 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4e11f-c3e2-4a65-9271-16c8ddb33187 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:36.710425 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4e11f-c3e2-4a65-9271-16c8ddb33187 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:36.727846 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 404/834] 10.222.0.82 () {56 vars in 1143 bytes} [Fri Aug 19 01:13:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:36.733770 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc1ccd-df33-4ff0-9ce7-145b59023903 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:36.835460 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc1ccd-df33-4ff0-9ce7-145b59023903 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:36.869891 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e85629-2119-4984-a0cd-d5045c5dad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:36.870488 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e85629-2119-4984-a0cd-d5045c5dad58 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:36.870766 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e85629-2119-4984-a0cd-d5045c5dad58 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:36.871055 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e85629-2119-4984-a0cd-d5045c5dad58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:36.899241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:36.941866 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e85629-2119-4984-a0cd-d5045c5dad58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:36.943246 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e85629-2119-4984-a0cd-d5045c5dad58 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:37.041308 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 431/835] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:13:36 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 01:13:37.046817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4e11f-c3e2-4a65-9271-16c8ddb33187 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:37.066142 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:37.147617 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4e11f-c3e2-4a65-9271-16c8ddb33187 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:37.182723 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1b5f2-9728-408e-9148-6e624a2c33df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:37.183347 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1b5f2-9728-408e-9148-6e624a2c33df None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:37.183626 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1b5f2-9728-408e-9148-6e624a2c33df None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:37.183894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1b5f2-9728-408e-9148-6e624a2c33df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:37.201054 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1b5f2-9728-408e-9148-6e624a2c33df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:37.201054 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1b5f2-9728-408e-9148-6e624a2c33df None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:37.210254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-78a1b5f2-9728-408e-9148-6e624a2c33df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:37.210254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:37.210254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:37.210254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:37.210254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:37.210254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:37.210254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:37.210254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:37.210254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:37.210254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:37.210254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:37.210254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:37.210254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:13:37.210254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:13:37.210254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:13:37.210254 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:37.211358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:13:37.212652 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:13:37.212652 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:37.212652 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:13:37.212652 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 405/836] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:37.217088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e85629-2119-4984-a0cd-d5045c5dad58 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:37.274527 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:37.314285 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e85629-2119-4984-a0cd-d5045c5dad58 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:37.348587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42695791-7d6c-46ef-8596-2bdc5ee29813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:37.349219 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42695791-7d6c-46ef-8596-2bdc5ee29813 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:37.349502 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42695791-7d6c-46ef-8596-2bdc5ee29813 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:37.349777 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42695791-7d6c-46ef-8596-2bdc5ee29813 None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:37.350436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42695791-7d6c-46ef-8596-2bdc5ee29813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:37.350738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42695791-7d6c-46ef-8596-2bdc5ee29813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:37.352101 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42695791-7d6c-46ef-8596-2bdc5ee29813 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:37.363177 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 432/837] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:37.368884 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1b5f2-9728-408e-9148-6e624a2c33df None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:37.437567 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:37.468937 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1b5f2-9728-408e-9148-6e624a2c33df None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:37.502538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb076675-e1fd-4597-892a-7a6c2b1c470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:37.503680 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb076675-e1fd-4597-892a-7a6c2b1c470c None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:37.504035 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb076675-e1fd-4597-892a-7a6c2b1c470c None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:37.504323 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb076675-e1fd-4597-892a-7a6c2b1c470c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:37.510909 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb076675-e1fd-4597-892a-7a6c2b1c470c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:37.512347 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb076675-e1fd-4597-892a-7a6c2b1c470c None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:37.524282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-cb076675-e1fd-4597-892a-7a6c2b1c470c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:13:37.524282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:37.524282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:37.524282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:37.524282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:37.524282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:37.524282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:37.524282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:37.524282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:37.524282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:37.524282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:37.524282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:37.524282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:13:37.524282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:13:37.524282 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:37.525354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:37.526507 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:13:37.526507 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:13:37.526507 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:13:37.526507 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:13:37.526507 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:13:37.526507 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:13:37.526507 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:13:37.526507 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:13:37.526507 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 406/838] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:13:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:37.531310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42695791-7d6c-46ef-8596-2bdc5ee29813 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:37.631287 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42695791-7d6c-46ef-8596-2bdc5ee29813 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:37.649116 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:37.666208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5342d4c-38e9-4a8e-aff9-2e478510599f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:37.666807 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5342d4c-38e9-4a8e-aff9-2e478510599f None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:37.667084 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5342d4c-38e9-4a8e-aff9-2e478510599f None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:37.667353 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5342d4c-38e9-4a8e-aff9-2e478510599f None admin] PATH_INFO: `/v3/projects` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:37.668034 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5342d4c-38e9-4a8e-aff9-2e478510599f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:37.668336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5342d4c-38e9-4a8e-aff9-2e478510599f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:37.669800 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5342d4c-38e9-4a8e-aff9-2e478510599f None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:37.682126 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 433/839] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:13:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:37.688276 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb076675-e1fd-4597-892a-7a6c2b1c470c None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:37.790663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb076675-e1fd-4597-892a-7a6c2b1c470c None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:37.821017 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:37.826696 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e60da-f25a-4ae9-a9a8-8337d598ec78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:37.827294 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e60da-f25a-4ae9-a9a8-8337d598ec78 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:37.827571 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e60da-f25a-4ae9-a9a8-8337d598ec78 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:37.827839 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e60da-f25a-4ae9-a9a8-8337d598ec78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:37.828547 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e60da-f25a-4ae9-a9a8-8337d598ec78 None admin] RBAC: Adding query filter params (role.id=c1ad293fe0c443e98339ca975dc18549, scope.project.id=b38e380f92824682a8286e59af2fc23c, user.id=246b63ecc51347f08daad24d75e3de27) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:37.828878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e60da-f25a-4ae9-a9a8-8337d598ec78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:37.830317 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e60da-f25a-4ae9-a9a8-8337d598ec78 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:37.835897 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 407/840] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:13:37 2022] GET /identity/v3/role_assignments?user.id=246b63ecc51347f08daad24d75e3de27&scope.project.id=b38e380f92824682a8286e59af2fc23c&role.id=c1ad293fe0c443e98339ca975dc18549 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:40.053031 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcb4a6-4189-441a-90ee-e37c7d769546 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:40.053608 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcb4a6-4189-441a-90ee-e37c7d769546 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:40.053608 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcb4a6-4189-441a-90ee-e37c7d769546 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:40.054919 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 434/841] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:13:40.060080 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de3b7f-5dea-4ffa-a78a-c95d856fd1a8 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:40.060504 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de3b7f-5dea-4ffa-a78a-c95d856fd1a8 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:40.060659 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de3b7f-5dea-4ffa-a78a-c95d856fd1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:40.078651 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-b5de3b7f-5dea-4ffa-a78a-c95d856fd1a8 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:13:40.079836 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-b5de3b7f-5dea-4ffa-a78a-c95d856fd1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:13:40.147139 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 408/842] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:13:40 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:13:40.479968 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcb4a6-4189-441a-90ee-e37c7d769546 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:40.586843 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcb4a6-4189-441a-90ee-e37c7d769546 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:40.621556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14050f-b500-4383-9005-9ae2e8df3781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:40.622181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14050f-b500-4383-9005-9ae2e8df3781 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:40.622463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14050f-b500-4383-9005-9ae2e8df3781 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:40.622735 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14050f-b500-4383-9005-9ae2e8df3781 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:40.633164 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14050f-b500-4383-9005-9ae2e8df3781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:13:40.637941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-4f14050f-b500-4383-9005-9ae2e8df3781 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:13:40.637941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:40.637941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:40.637941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:40.637941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:40.637941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:40.637941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:40.637941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:40.637941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:40.637941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:40.637941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:40.637941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:40.637941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:13:40.637941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:13:40.637941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:13:40.637941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:13:40.639075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:13:40.639075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:13:40.639075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:13:40.639075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:13:40.639075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:40.639075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:40.639075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:40.639075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:40.639075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:40.639075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:40.639075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:40.639075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:40.639075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:40.639075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:40.639075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:40.639075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:40.640125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:40.640125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:40.640125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:40.640125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:40.640125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:13:40.640125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:13:40.640125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:13:40.640125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:13:40.640125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:13:40.640125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:13:40.640125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:13:40.640125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:13:40.640125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 435/843] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:40.645224 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de3b7f-5dea-4ffa-a78a-c95d856fd1a8 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:40.744428 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de3b7f-5dea-4ffa-a78a-c95d856fd1a8 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:40.767746 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:40.779091 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc443d1-a34f-4cd5-b3bb-c21d85acca41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:40.779696 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc443d1-a34f-4cd5-b3bb-c21d85acca41 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:40.779970 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc443d1-a34f-4cd5-b3bb-c21d85acca41 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:40.780257 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc443d1-a34f-4cd5-b3bb-c21d85acca41 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:40.780986 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc443d1-a34f-4cd5-b3bb-c21d85acca41 None admin] RBAC: Adding query filter params (name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:40.781306 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc443d1-a34f-4cd5-b3bb-c21d85acca41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:40.782690 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc443d1-a34f-4cd5-b3bb-c21d85acca41 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:40.790899 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 409/844] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Aug 19 01:13:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:13:40.796660 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14050f-b500-4383-9005-9ae2e8df3781 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:40.836438 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:40.895570 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14050f-b500-4383-9005-9ae2e8df3781 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:40.928873 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fce930-2958-4395-a984-bd2bed49db30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:40.929528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fce930-2958-4395-a984-bd2bed49db30 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:40.929806 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fce930-2958-4395-a984-bd2bed49db30 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:40.930078 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fce930-2958-4395-a984-bd2bed49db30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:40.939676 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fce930-2958-4395-a984-bd2bed49db30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:40.941796 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fce930-2958-4395-a984-bd2bed49db30 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:40.956717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-c3fce930-2958-4395-a984-bd2bed49db30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:40.956717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:40.956717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:40.956717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:40.956717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:40.956717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:40.956717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:40.956717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:40.956717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:40.956717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:40.956717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:40.956717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:40.956717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:13:40.956717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:13:40.956717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:13:40.956717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:40.957874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:13:40.958789 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:13:40.958789 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:40.958789 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:13:40.958789 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 436/845] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:40.963932 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc443d1-a34f-4cd5-b3bb-c21d85acca41 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:41.064914 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc443d1-a34f-4cd5-b3bb-c21d85acca41 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:41.100173 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e312-eb14-4f9c-aa4e-8a6be0754f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:41.100776 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e312-eb14-4f9c-aa4e-8a6be0754f0c None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:41.101101 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e312-eb14-4f9c-aa4e-8a6be0754f0c None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:41.101376 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e312-eb14-4f9c-aa4e-8a6be0754f0c None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:41.101994 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2e312-eb14-4f9c-aa4e-8a6be0754f0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:41.102298 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2e312-eb14-4f9c-aa4e-8a6be0754f0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:41.103669 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2e312-eb14-4f9c-aa4e-8a6be0754f0c None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:41.116202 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 410/846] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:41.122112 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fce930-2958-4395-a984-bd2bed49db30 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:41.211920 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:41.221012 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fce930-2958-4395-a984-bd2bed49db30 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:41.254267 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e2d76-2278-4f6e-bc45-ee936344ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:41.254885 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e2d76-2278-4f6e-bc45-ee936344ce44 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:41.255167 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e2d76-2278-4f6e-bc45-ee936344ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:41.255437 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e2d76-2278-4f6e-bc45-ee936344ce44 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:41.262957 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e2d76-2278-4f6e-bc45-ee936344ce44 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:41.264458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e2d76-2278-4f6e-bc45-ee936344ce44 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:41.276088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-ef4e2d76-2278-4f6e-bc45-ee936344ce44 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 01:13:41.276088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:41.276088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:41.276088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:41.276088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:41.276088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:41.276088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:41.276088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:41.276088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:41.276088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:41.276088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:41.276088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:41.276088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:13:41.276088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:13:41.276088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:13:41.276088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:41.277310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:41.278424 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:41.278424 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:41.278424 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:13:41.278424 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:13:41.278424 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:13:41.278424 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:13:41.278424 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:13:41.278424 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:13:41.278424 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 01:13:41.278424 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:13:41.278424 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 437/847] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:41.283221 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e312-eb14-4f9c-aa4e-8a6be0754f0c None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:41.330644 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:41.382060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e312-eb14-4f9c-aa4e-8a6be0754f0c None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:41.415940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25a428-ebb3-4581-a400-91813ffc0463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:41.416539 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25a428-ebb3-4581-a400-91813ffc0463 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:41.416820 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25a428-ebb3-4581-a400-91813ffc0463 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:41.417127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25a428-ebb3-4581-a400-91813ffc0463 None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:41.417846 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25a428-ebb3-4581-a400-91813ffc0463 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:41.418151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25a428-ebb3-4581-a400-91813ffc0463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:41.419586 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25a428-ebb3-4581-a400-91813ffc0463 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:41.437002 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 411/848] 10.222.0.82 () {56 vars in 1143 bytes} [Fri Aug 19 01:13:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:41.442943 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e2d76-2278-4f6e-bc45-ee936344ce44 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:41.542592 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e2d76-2278-4f6e-bc45-ee936344ce44 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:41.577137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3deb44-270d-4cf0-b8b3-bb7e7be73651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:41.577833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3deb44-270d-4cf0-b8b3-bb7e7be73651 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:41.578114 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3deb44-270d-4cf0-b8b3-bb7e7be73651 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:41.578383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3deb44-270d-4cf0-b8b3-bb7e7be73651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:41.589675 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3deb44-270d-4cf0-b8b3-bb7e7be73651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:41.591048 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3deb44-270d-4cf0-b8b3-bb7e7be73651 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:41.606351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-cd3deb44-270d-4cf0-b8b3-bb7e7be73651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:41.606351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:41.606351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:41.606351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:41.606351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:41.606351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:41.606351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:41.606351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:41.606351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:41.606351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:41.606351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:41.606351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:41.606351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:13:41.606351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:13:41.606351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:13:41.606351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:41.610761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:13:41.611891 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:13:41.611891 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:41.611891 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:13:41.611891 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 438/849] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:41.613339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25a428-ebb3-4581-a400-91813ffc0463 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:41.714757 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25a428-ebb3-4581-a400-91813ffc0463 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:41.717028 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:41.748510 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6ad8d-cf59-427c-a1a7-0a9212346666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:41.749137 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6ad8d-cf59-427c-a1a7-0a9212346666 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:41.749415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6ad8d-cf59-427c-a1a7-0a9212346666 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:41.749682 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6ad8d-cf59-427c-a1a7-0a9212346666 None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:41.750310 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6ad8d-cf59-427c-a1a7-0a9212346666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:41.750606 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6ad8d-cf59-427c-a1a7-0a9212346666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:41.751974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6ad8d-cf59-427c-a1a7-0a9212346666 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:41.762776 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 412/850] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:41.768610 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3deb44-270d-4cf0-b8b3-bb7e7be73651 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:41.772381 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:41.873456 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3deb44-270d-4cf0-b8b3-bb7e7be73651 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:41.907067 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957ba1f-6ac1-413c-a0d8-b4ce652259ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:41.907779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957ba1f-6ac1-413c-a0d8-b4ce652259ec None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:41.908056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957ba1f-6ac1-413c-a0d8-b4ce652259ec None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:41.908328 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957ba1f-6ac1-413c-a0d8-b4ce652259ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:41.915982 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957ba1f-6ac1-413c-a0d8-b4ce652259ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:41.917473 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957ba1f-6ac1-413c-a0d8-b4ce652259ec None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:41.929286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-8957ba1f-6ac1-413c-a0d8-b4ce652259ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:13:41.929286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:41.929286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:41.929286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:41.929286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:41.929286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:41.929286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:41.929286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:41.929286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:41.929286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:41.929286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:41.929286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:41.929286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:13:41.929286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:13:41.929286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:41.930334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:41.931530 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:13:41.931530 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:13:41.931530 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:13:41.931530 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:13:41.931530 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:13:41.931530 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:13:41.931530 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:13:41.931530 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:13:41.931530 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 439/851] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:13:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:41.936418 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6ad8d-cf59-427c-a1a7-0a9212346666 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:42.037767 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6ad8d-cf59-427c-a1a7-0a9212346666 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:42.070790 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844bdd5-d62a-4ca5-98b3-92019898704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:42.071410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844bdd5-d62a-4ca5-98b3-92019898704b None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:42.071725 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844bdd5-d62a-4ca5-98b3-92019898704b None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:42.071997 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844bdd5-d62a-4ca5-98b3-92019898704b None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:42.072685 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844bdd5-d62a-4ca5-98b3-92019898704b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:42.073029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844bdd5-d62a-4ca5-98b3-92019898704b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:42.074460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844bdd5-d62a-4ca5-98b3-92019898704b None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:42.086874 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 413/852] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:13:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:42.093014 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957ba1f-6ac1-413c-a0d8-b4ce652259ec None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:42.154830 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:42.192839 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957ba1f-6ac1-413c-a0d8-b4ce652259ec None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:42.226837 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefaec17-6b8d-46a9-86e0-88b101ebeb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:42.227489 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefaec17-6b8d-46a9-86e0-88b101ebeb3a None admin] REQUEST_METHOD: `PUT` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:42.227770 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefaec17-6b8d-46a9-86e0-88b101ebeb3a None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:42.228044 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefaec17-6b8d-46a9-86e0-88b101ebeb3a None admin] PATH_INFO: `/v3/projects/b38e380f92824682a8286e59af2fc23c/users/246b63ecc51347f08daad24d75e3de27/roles/c1ad293fe0c443e98339ca975dc18549` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:42.242808 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefaec17-6b8d-46a9-86e0-88b101ebeb3a None admin] RBAC: Authorizing `identity:create_grant(project_id=b38e380f92824682a8286e59af2fc23c, user_id=246b63ecc51347f08daad24d75e3de27, role_id=c1ad293fe0c443e98339ca975dc18549)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:42.244264 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefaec17-6b8d-46a9-86e0-88b101ebeb3a None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:42.321892 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 440/853] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Aug 19 01:13:42 2022] PUT /identity/v3/projects/b38e380f92824682a8286e59af2fc23c/users/246b63ecc51347f08daad24d75e3de27/roles/c1ad293fe0c443e98339ca975dc18549 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:13:44.474413 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c1a9d-2826-4a94-8a86-082b898618da None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:44.474974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c1a9d-2826-4a94-8a86-082b898618da None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:44.474974 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c1a9d-2826-4a94-8a86-082b898618da None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:44.476285 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 414/854] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:13:44.481551 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eb87b-11fa-4051-8478-e413728f47b6 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:44.482754 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eb87b-11fa-4051-8478-e413728f47b6 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:44.482754 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eb87b-11fa-4051-8478-e413728f47b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:44.500102 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-0e1eb87b-11fa-4051-8478-e413728f47b6 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:13:44.501302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-0e1eb87b-11fa-4051-8478-e413728f47b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:13:44.569161 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 441/855] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:13:44 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:13:44.896822 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c1a9d-2826-4a94-8a86-082b898618da None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:44.921939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:44.999164 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c1a9d-2826-4a94-8a86-082b898618da None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:45.033289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546410e-174c-4826-833e-390dffe6d9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:45.033910 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546410e-174c-4826-833e-390dffe6d9a2 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:45.034187 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546410e-174c-4826-833e-390dffe6d9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:45.034454 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546410e-174c-4826-833e-390dffe6d9a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:45.046012 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546410e-174c-4826-833e-390dffe6d9a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:13:45.052004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-b546410e-174c-4826-833e-390dffe6d9a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:13:45.052004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:45.052004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:45.052004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:45.052004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:45.052004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:45.052004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:45.052004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:45.052004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:45.052004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:45.052004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:45.052004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:45.052004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:13:45.052004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:13:45.052004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:13:45.052004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:13:45.055250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:13:45.055250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:13:45.055250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:13:45.055250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:13:45.055250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:45.055250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:45.055250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:45.055250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:45.055250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:45.055250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:45.055250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:45.055250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:45.055250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:45.055250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:45.055250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:45.055250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:45.056279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:45.056279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:45.056279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:45.056279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:45.056279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:13:45.056279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:13:45.056279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:13:45.056279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:13:45.056279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:13:45.056279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:13:45.056279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 01:13:45.056279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:13:45.056279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 415/856] 10.222.0.82 () {56 vars in 1102 bytes} [Fri Aug 19 01:13:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:45.059044 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eb87b-11fa-4051-8478-e413728f47b6 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:45.102129 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:45.157973 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eb87b-11fa-4051-8478-e413728f47b6 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:45.193165 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56739c-8af4-4981-8169-881e177267e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:45.196060 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56739c-8af4-4981-8169-881e177267e6 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:45.196060 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56739c-8af4-4981-8169-881e177267e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:45.196060 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56739c-8af4-4981-8169-881e177267e6 None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:45.196060 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56739c-8af4-4981-8169-881e177267e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:45.196060 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56739c-8af4-4981-8169-881e177267e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:45.196572 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56739c-8af4-4981-8169-881e177267e6 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:45.204352 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 442/857] 10.222.0.82 () {56 vars in 1103 bytes} [Fri Aug 19 01:13:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:45.210469 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546410e-174c-4826-833e-390dffe6d9a2 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:45.295658 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:45.311802 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546410e-174c-4826-833e-390dffe6d9a2 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:45.344568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807a7f7-c549-4852-924b-dfdbb68c7342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:45.345215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807a7f7-c549-4852-924b-dfdbb68c7342 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:45.345494 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807a7f7-c549-4852-924b-dfdbb68c7342 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:45.345764 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807a7f7-c549-4852-924b-dfdbb68c7342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:45.355973 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807a7f7-c549-4852-924b-dfdbb68c7342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:45.357441 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807a7f7-c549-4852-924b-dfdbb68c7342 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:45.372130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-7807a7f7-c549-4852-924b-dfdbb68c7342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:45.372130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:45.372130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:45.372130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:45.372130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:45.372130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:45.372130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:45.372130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:45.372130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:45.372130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:45.372130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:45.372130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:45.372130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:13:45.372130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:13:45.372130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:13:45.372130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:45.380045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:13:45.381188 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:13:45.381188 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:45.381188 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:13:45.381188 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 416/858] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:45.381478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56739c-8af4-4981-8169-881e177267e6 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:45.481399 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56739c-8af4-4981-8169-881e177267e6 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:45.483642 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:45.514546 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781af00-848d-42bb-bd41-860a2003f04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:45.515179 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781af00-848d-42bb-bd41-860a2003f04c None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:45.515463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781af00-848d-42bb-bd41-860a2003f04c None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:45.515738 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781af00-848d-42bb-bd41-860a2003f04c None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:45.516374 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781af00-848d-42bb-bd41-860a2003f04c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:45.516679 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781af00-848d-42bb-bd41-860a2003f04c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:45.518098 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781af00-848d-42bb-bd41-860a2003f04c None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:45.530330 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 443/859] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:45.536796 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807a7f7-c549-4852-924b-dfdbb68c7342 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:45.639745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807a7f7-c549-4852-924b-dfdbb68c7342 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:45.673822 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106b6bc-b662-4f83-b955-7d35f27fdedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:45.674442 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106b6bc-b662-4f83-b955-7d35f27fdedd None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:45.674729 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106b6bc-b662-4f83-b955-7d35f27fdedd None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:45.674998 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106b6bc-b662-4f83-b955-7d35f27fdedd None admin] PATH_INFO: `/v3/users/placement` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:45.678233 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:45.683161 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106b6bc-b662-4f83-b955-7d35f27fdedd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:45.684599 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106b6bc-b662-4f83-b955-7d35f27fdedd None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:45.696316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-f106b6bc-b662-4f83-b955-7d35f27fdedd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 01:13:45.696316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:45.696316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:45.696316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:45.696316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:45.696316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:45.696316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:45.696316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:45.696316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:45.696316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:45.696316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:45.696316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:45.696316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:13:45.696316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:13:45.696316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:13:45.696316 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:45.697460 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:45.698627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:45.698627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:45.698627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:13:45.698627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:13:45.698627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:13:45.698627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:13:45.698627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:13:45.698627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:13:45.698627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 01:13:45.698627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:13:45.698627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 417/860] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:45.703380 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781af00-848d-42bb-bd41-860a2003f04c None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:45.806476 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781af00-848d-42bb-bd41-860a2003f04c None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:45.838834 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76906240-90cd-4538-b938-0357249fe142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:45.839426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76906240-90cd-4538-b938-0357249fe142 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:45.839700 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76906240-90cd-4538-b938-0357249fe142 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:45.839968 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76906240-90cd-4538-b938-0357249fe142 None admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:45.842955 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76906240-90cd-4538-b938-0357249fe142 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:45.842955 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76906240-90cd-4538-b938-0357249fe142 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:45.842955 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76906240-90cd-4538-b938-0357249fe142 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:45.860370 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 444/861] 10.222.0.82 () {56 vars in 1143 bytes} [Fri Aug 19 01:13:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:45.867537 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106b6bc-b662-4f83-b955-7d35f27fdedd None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:45.964441 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106b6bc-b662-4f83-b955-7d35f27fdedd None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:45.997801 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d3ed8-e9d0-46d2-b097-73dd6522f6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:45.998393 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d3ed8-e9d0-46d2-b097-73dd6522f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:45.998669 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d3ed8-e9d0-46d2-b097-73dd6522f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:45.998936 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d3ed8-e9d0-46d2-b097-73dd6522f6f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:46.061101 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:46.067467 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d3ed8-e9d0-46d2-b097-73dd6522f6f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:46.069294 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d3ed8-e9d0-46d2-b097-73dd6522f6f1 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:46.164555 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 418/862] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:13:45 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 01:13:46.170426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76906240-90cd-4538-b938-0357249fe142 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:46.194730 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:46.270984 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76906240-90cd-4538-b938-0357249fe142 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:46.305259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d46fe-a4ea-4aad-916c-86f3ffa0f343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:46.305867 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d46fe-a4ea-4aad-916c-86f3ffa0f343 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:46.306145 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d46fe-a4ea-4aad-916c-86f3ffa0f343 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:46.306415 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d46fe-a4ea-4aad-916c-86f3ffa0f343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:46.316340 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d46fe-a4ea-4aad-916c-86f3ffa0f343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:46.317872 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d46fe-a4ea-4aad-916c-86f3ffa0f343 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:46.333100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-539d46fe-a4ea-4aad-916c-86f3ffa0f343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:46.333100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:46.333100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:46.333100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:46.333100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:46.333100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:46.333100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:46.333100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:46.333100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:46.333100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:46.333100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:46.333100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:46.333100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:13:46.333100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:13:46.333100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:13:46.333100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:46.334266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:13:46.335343 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:13:46.335343 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:46.335343 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:13:46.335343 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 445/863] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:46.340014 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d3ed8-e9d0-46d2-b097-73dd6522f6f1 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:46.432560 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:46.438270 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d3ed8-e9d0-46d2-b097-73dd6522f6f1 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:46.471822 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f8616-e008-4c1a-8e12-a76cfee13d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:46.472976 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f8616-e008-4c1a-8e12-a76cfee13d32 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:46.473402 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f8616-e008-4c1a-8e12-a76cfee13d32 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:46.473685 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f8616-e008-4c1a-8e12-a76cfee13d32 None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:46.474338 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f8616-e008-4c1a-8e12-a76cfee13d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:46.474639 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f8616-e008-4c1a-8e12-a76cfee13d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:46.476011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f8616-e008-4c1a-8e12-a76cfee13d32 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:46.487039 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 419/864] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:13:46.493120 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d46fe-a4ea-4aad-916c-86f3ffa0f343 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:46.570538 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:46.594929 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d46fe-a4ea-4aad-916c-86f3ffa0f343 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:46.627404 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09193a0-fe04-42dd-baef-7c0862dac8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:46.628022 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09193a0-fe04-42dd-baef-7c0862dac8e5 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:46.628300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09193a0-fe04-42dd-baef-7c0862dac8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:46.629126 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09193a0-fe04-42dd-baef-7c0862dac8e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:46.636205 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09193a0-fe04-42dd-baef-7c0862dac8e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:46.640794 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09193a0-fe04-42dd-baef-7c0862dac8e5 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:46.653372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-e09193a0-fe04-42dd-baef-7c0862dac8e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:13:46.653372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:46.653372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:46.653372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:46.653372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:46.653372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:46.653372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:46.653372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:46.653372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:46.653372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:46.653372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:46.653372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:46.653372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:13:46.653372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:13:46.653372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:46.659391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:46.666099 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:13:46.666099 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:13:46.666099 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:13:46.666099 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:13:46.666099 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:13:46.666099 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:13:46.666099 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:13:46.666099 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:13:46.666099 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 446/865] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:13:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:46.666712 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f8616-e008-4c1a-8e12-a76cfee13d32 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:46.762046 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f8616-e008-4c1a-8e12-a76cfee13d32 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:46.797600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238741a-3ca5-4381-b674-2f18c28f3cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:46.798210 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238741a-3ca5-4381-b674-2f18c28f3cf4 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:46.798490 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238741a-3ca5-4381-b674-2f18c28f3cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:46.798762 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238741a-3ca5-4381-b674-2f18c28f3cf4 None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:46.799445 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238741a-3ca5-4381-b674-2f18c28f3cf4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:46.799748 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238741a-3ca5-4381-b674-2f18c28f3cf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:46.801389 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238741a-3ca5-4381-b674-2f18c28f3cf4 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:46.813218 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 420/866] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:13:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:46.819966 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09193a0-fe04-42dd-baef-7c0862dac8e5 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:46.918851 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09193a0-fe04-42dd-baef-7c0862dac8e5 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:46.952598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577a6fd-dc0b-4ec8-a570-89548e9a4b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:46.953299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577a6fd-dc0b-4ec8-a570-89548e9a4b53 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:46.953581 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577a6fd-dc0b-4ec8-a570-89548e9a4b53 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:46.953850 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577a6fd-dc0b-4ec8-a570-89548e9a4b53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:46.954555 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577a6fd-dc0b-4ec8-a570-89548e9a4b53 None admin] RBAC: Adding query filter params (role.id=c1ad293fe0c443e98339ca975dc18549, scope.project.id=b38e380f92824682a8286e59af2fc23c, user.id=246b63ecc51347f08daad24d75e3de27) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:46.954857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577a6fd-dc0b-4ec8-a570-89548e9a4b53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:46.956303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577a6fd-dc0b-4ec8-a570-89548e9a4b53 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:46.958192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:46.962605 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 447/867] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:13:46 2022] GET /identity/v3/role_assignments?user.id=246b63ecc51347f08daad24d75e3de27&scope.project.id=b38e380f92824682a8286e59af2fc23c&role.id=c1ad293fe0c443e98339ca975dc18549 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:49.209366 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a8d10-bb0d-4c1b-bce8-4f9bb15dc4e3 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:49.209930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a8d10-bb0d-4c1b-bce8-4f9bb15dc4e3 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:49.209930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a8d10-bb0d-4c1b-bce8-4f9bb15dc4e3 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:49.211251 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 421/868] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:13:49.216472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21125c-c871-4430-8311-a0e9985937b3 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:49.217496 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21125c-c871-4430-8311-a0e9985937b3 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:49.217496 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21125c-c871-4430-8311-a0e9985937b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:49.235517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-0a21125c-c871-4430-8311-a0e9985937b3 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:13:49.236696 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-0a21125c-c871-4430-8311-a0e9985937b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:13:49.311667 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 448/869] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:13:49 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:13:49.649538 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a8d10-bb0d-4c1b-bce8-4f9bb15dc4e3 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:49.668078 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:49.752418 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a8d10-bb0d-4c1b-bce8-4f9bb15dc4e3 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:49.787359 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba03231-55e1-49ca-8acc-48828ef574b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:49.787981 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba03231-55e1-49ca-8acc-48828ef574b7 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:49.788259 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba03231-55e1-49ca-8acc-48828ef574b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:49.788526 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba03231-55e1-49ca-8acc-48828ef574b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:49.798320 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba03231-55e1-49ca-8acc-48828ef574b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:13:49.804286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-bba03231-55e1-49ca-8acc-48828ef574b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:13:49.804286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:49.804286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:49.804286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:49.804286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:49.804286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:49.804286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:49.804286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:49.804286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:49.804286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:49.804286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:49.804286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:49.804286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:13:49.804286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:13:49.804286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:13:49.804286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:13:49.805403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:13:49.805403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:13:49.805403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:13:49.805403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:13:49.805403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:49.805403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:49.805403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:49.805403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:49.805403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:49.805403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:49.805403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:49.805403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:49.805403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:49.805403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:49.805403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:49.805403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:49.806351 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:49.806351 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:49.806351 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:49.806351 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:49.806351 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:13:49.806351 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:13:49.806351 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:13:49.806351 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:13:49.806351 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:13:49.806351 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:13:49.806351 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:13:49.806351 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:13:49.806351 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 422/870] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:13:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:49.811382 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21125c-c871-4430-8311-a0e9985937b3 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:49.908548 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21125c-c871-4430-8311-a0e9985937b3 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:49.936057 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:49.943678 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0928524-c777-44c4-bace-0254e6b17f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:49.944275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0928524-c777-44c4-bace-0254e6b17f1e None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:49.944549 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0928524-c777-44c4-bace-0254e6b17f1e None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:49.944812 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0928524-c777-44c4-bace-0254e6b17f1e None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:49.945489 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0928524-c777-44c4-bace-0254e6b17f1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:49.945782 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0928524-c777-44c4-bace-0254e6b17f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:49.947133 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0928524-c777-44c4-bace-0254e6b17f1e None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:49.954887 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 449/871] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:13:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:49.961363 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba03231-55e1-49ca-8acc-48828ef574b7 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:50.040185 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:50.063820 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba03231-55e1-49ca-8acc-48828ef574b7 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:50.098865 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a5908-a79b-416c-ac98-86976df4b5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:50.099488 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a5908-a79b-416c-ac98-86976df4b5b9 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:50.099767 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a5908-a79b-416c-ac98-86976df4b5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:50.100039 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a5908-a79b-416c-ac98-86976df4b5b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:50.109704 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a5908-a79b-416c-ac98-86976df4b5b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:50.111142 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a5908-a79b-416c-ac98-86976df4b5b9 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:50.126415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-010a5908-a79b-416c-ac98-86976df4b5b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:50.126415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:50.126415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:50.126415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:50.126415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:50.126415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:50.126415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:50.126415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:50.126415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:50.126415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:50.126415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:50.126415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:50.126415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:13:50.126415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:13:50.126415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:13:50.126415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:50.127422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:13:50.128309 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:13:50.128309 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:50.128309 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:13:50.128309 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 423/872] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:13:50.133708 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0928524-c777-44c4-bace-0254e6b17f1e None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:50.232543 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0928524-c777-44c4-bace-0254e6b17f1e None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:50.265364 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201930a-7ef5-42ed-afce-4f76994327d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:50.265956 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201930a-7ef5-42ed-afce-4f76994327d5 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:50.266232 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201930a-7ef5-42ed-afce-4f76994327d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:50.266498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201930a-7ef5-42ed-afce-4f76994327d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:50.267117 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201930a-7ef5-42ed-afce-4f76994327d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:50.267414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201930a-7ef5-42ed-afce-4f76994327d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:50.268812 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201930a-7ef5-42ed-afce-4f76994327d5 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:50.282723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 450/873] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:50.289211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a5908-a79b-416c-ac98-86976df4b5b9 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:50.388463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a5908-a79b-416c-ac98-86976df4b5b9 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:50.414162 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:50.421616 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ac387-363c-40c3-b7ae-7f6fb488ba61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:50.422228 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ac387-363c-40c3-b7ae-7f6fb488ba61 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:50.422501 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ac387-363c-40c3-b7ae-7f6fb488ba61 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:50.422767 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ac387-363c-40c3-b7ae-7f6fb488ba61 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:50.430463 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ac387-363c-40c3-b7ae-7f6fb488ba61 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:50.431894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ac387-363c-40c3-b7ae-7f6fb488ba61 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:50.442545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-924ac387-363c-40c3-b7ae-7f6fb488ba61 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 01:13:50.442545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:50.442545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:50.442545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:50.442545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:50.442545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:50.442545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:50.442545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:50.442545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:50.442545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:50.442545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:50.442545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:50.442545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:13:50.442545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:13:50.442545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:13:50.442545 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:50.443677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:50.444593 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:50.444593 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:50.444593 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:13:50.444593 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:13:50.444593 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:13:50.444593 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:13:50.444593 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:13:50.444593 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:13:50.444593 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 01:13:50.444593 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:13:50.444593 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 424/874] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:50.449572 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201930a-7ef5-42ed-afce-4f76994327d5 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:50.499970 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:50.548683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201930a-7ef5-42ed-afce-4f76994327d5 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:50.583719 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39793ab3-5ce7-447d-993f-e657cd6c69d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:50.584349 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39793ab3-5ce7-447d-993f-e657cd6c69d9 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:50.584629 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39793ab3-5ce7-447d-993f-e657cd6c69d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:50.585094 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39793ab3-5ce7-447d-993f-e657cd6c69d9 None admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:50.585833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39793ab3-5ce7-447d-993f-e657cd6c69d9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:50.586136 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39793ab3-5ce7-447d-993f-e657cd6c69d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:50.587559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39793ab3-5ce7-447d-993f-e657cd6c69d9 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:50.605241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 451/875] 10.222.0.82 () {56 vars in 1143 bytes} [Fri Aug 19 01:13:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:50.611277 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ac387-363c-40c3-b7ae-7f6fb488ba61 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:50.714485 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ac387-363c-40c3-b7ae-7f6fb488ba61 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:50.748678 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4df15-0d57-4f06-925d-e3d8a7c4fa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:50.749354 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4df15-0d57-4f06-925d-e3d8a7c4fa8c None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:50.749633 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4df15-0d57-4f06-925d-e3d8a7c4fa8c None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:50.749900 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4df15-0d57-4f06-925d-e3d8a7c4fa8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:50.805159 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:50.817259 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4df15-0d57-4f06-925d-e3d8a7c4fa8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:50.818872 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4df15-0d57-4f06-925d-e3d8a7c4fa8c None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:50.915341 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 425/876] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:13:50 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 01:13:50.921316 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39793ab3-5ce7-447d-993f-e657cd6c69d9 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:51.022706 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39793ab3-5ce7-447d-993f-e657cd6c69d9 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:51.031749 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:51.056747 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342ab63-4bab-48dd-9a1c-3c8841f44e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:51.057445 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ab63-4bab-48dd-9a1c-3c8841f44e5a None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:51.057751 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ab63-4bab-48dd-9a1c-3c8841f44e5a None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:51.058023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ab63-4bab-48dd-9a1c-3c8841f44e5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:51.067945 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342ab63-4bab-48dd-9a1c-3c8841f44e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:51.069463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342ab63-4bab-48dd-9a1c-3c8841f44e5a None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:51.083914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-a342ab63-4bab-48dd-9a1c-3c8841f44e5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:51.083914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:51.083914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:51.083914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:51.083914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:51.083914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:51.083914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:51.083914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:51.083914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:51.083914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:51.083914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:51.083914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:51.083914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:13:51.083914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:13:51.083914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:13:51.083914 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:51.085068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:13:51.086374 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:13:51.086374 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:51.086374 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:13:51.086374 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 452/877] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:51.090735 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4df15-0d57-4f06-925d-e3d8a7c4fa8c None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:51.179561 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:51.191056 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4df15-0d57-4f06-925d-e3d8a7c4fa8c None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:51.224084 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851defb-8153-4ed4-bdcb-25750071e51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:51.224679 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851defb-8153-4ed4-bdcb-25750071e51d None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:51.224984 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851defb-8153-4ed4-bdcb-25750071e51d None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:51.225261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851defb-8153-4ed4-bdcb-25750071e51d None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:51.225882 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851defb-8153-4ed4-bdcb-25750071e51d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:51.226177 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851defb-8153-4ed4-bdcb-25750071e51d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:51.227530 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851defb-8153-4ed4-bdcb-25750071e51d None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:51.239293 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 426/878] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:51.245039 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342ab63-4bab-48dd-9a1c-3c8841f44e5a None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:51.344579 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342ab63-4bab-48dd-9a1c-3c8841f44e5a None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:51.378262 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690747a6-ad2e-4d55-bc70-3ccc653767d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:51.379151 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690747a6-ad2e-4d55-bc70-3ccc653767d5 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:51.379432 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690747a6-ad2e-4d55-bc70-3ccc653767d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:51.379704 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690747a6-ad2e-4d55-bc70-3ccc653767d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:51.386207 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690747a6-ad2e-4d55-bc70-3ccc653767d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:51.387642 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690747a6-ad2e-4d55-bc70-3ccc653767d5 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:51.399478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-690747a6-ad2e-4d55-bc70-3ccc653767d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:13:51.399478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:51.399478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:51.399478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:51.399478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:51.399478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:51.399478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:51.399478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:51.399478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:51.399478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:51.399478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:51.399478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:51.399478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:13:51.399478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:13:51.399478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:51.400557 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:51.401670 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:13:51.401670 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:13:51.401670 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:13:51.401670 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:13:51.401670 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:13:51.401670 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:13:51.401670 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:13:51.401670 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:13:51.401670 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 453/879] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:13:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:51.406557 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851defb-8153-4ed4-bdcb-25750071e51d None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:51.505915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851defb-8153-4ed4-bdcb-25750071e51d None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:51.541528 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c726b6-67c0-4cef-aa69-e7461443b3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:51.542117 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c726b6-67c0-4cef-aa69-e7461443b3be None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:51.542399 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c726b6-67c0-4cef-aa69-e7461443b3be None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:51.542673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c726b6-67c0-4cef-aa69-e7461443b3be None admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:51.543363 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c726b6-67c0-4cef-aa69-e7461443b3be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:51.543666 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c726b6-67c0-4cef-aa69-e7461443b3be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:51.545145 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c726b6-67c0-4cef-aa69-e7461443b3be None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:51.558094 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 427/880] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:13:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:51.564373 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690747a6-ad2e-4d55-bc70-3ccc653767d5 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:51.586936 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:51.665116 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690747a6-ad2e-4d55-bc70-3ccc653767d5 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:51.699175 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b57a3-1eb8-4da4-8275-4eb92ffd9cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:51.699764 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b57a3-1eb8-4da4-8275-4eb92ffd9cfd None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:51.700039 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b57a3-1eb8-4da4-8275-4eb92ffd9cfd None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:51.700305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b57a3-1eb8-4da4-8275-4eb92ffd9cfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:51.701053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b57a3-1eb8-4da4-8275-4eb92ffd9cfd None admin] RBAC: Adding query filter params (role.id=fda5389edef24d6baac46d87242d285b, scope.project.id=b38e380f92824682a8286e59af2fc23c, user.id=246b63ecc51347f08daad24d75e3de27) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:51.701358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b57a3-1eb8-4da4-8275-4eb92ffd9cfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:51.702831 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b57a3-1eb8-4da4-8275-4eb92ffd9cfd None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:51.709246 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 454/881] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:13:51 2022] GET /identity/v3/role_assignments?user.id=246b63ecc51347f08daad24d75e3de27&scope.project.id=b38e380f92824682a8286e59af2fc23c&role.id=fda5389edef24d6baac46d87242d285b => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:53.882512 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f84e5-da18-404c-b801-2cc39808acdf None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:53.883030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f84e5-da18-404c-b801-2cc39808acdf None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:53.883142 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f84e5-da18-404c-b801-2cc39808acdf None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:53.884380 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 428/882] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:13:53.889630 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a8a81-ed0b-4a10-af75-1cf49c0f9c9e None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:53.889999 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a8a81-ed0b-4a10-af75-1cf49c0f9c9e None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:53.890183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a8a81-ed0b-4a10-af75-1cf49c0f9c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:53.908558 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-102a8a81-ed0b-4a10-af75-1cf49c0f9c9e None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:13:53.910109 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-102a8a81-ed0b-4a10-af75-1cf49c0f9c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:13:53.977273 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 455/883] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:13:53 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:13:54.302813 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f84e5-da18-404c-b801-2cc39808acdf None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:54.313968 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:54.405397 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f84e5-da18-404c-b801-2cc39808acdf None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:54.443367 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4631c-5a70-4028-b9ee-89b8d2ddb7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:54.443989 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4631c-5a70-4028-b9ee-89b8d2ddb7f7 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:54.444292 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4631c-5a70-4028-b9ee-89b8d2ddb7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:54.444562 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4631c-5a70-4028-b9ee-89b8d2ddb7f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:54.454585 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4631c-5a70-4028-b9ee-89b8d2ddb7f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:13:54.459840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-8bf4631c-5a70-4028-b9ee-89b8d2ddb7f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:13:54.459840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:54.459840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:54.459840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:54.459840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:54.459840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:54.459840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:54.459840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:54.459840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:54.459840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:54.459840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:54.459840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:54.459840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:13:54.459840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:13:54.459840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:13:54.459840 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:13:54.461103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:13:54.461103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:13:54.461103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:13:54.461103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:13:54.461103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:54.461103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:54.461103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:54.461103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:54.461103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:54.461103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:54.461103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:54.461103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:54.461103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:54.461103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:54.461103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:54.461103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:54.462011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:54.462011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:54.462011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:54.462011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:54.462011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:13:54.462011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:13:54.462011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:13:54.462011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:13:54.462011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:13:54.462011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:13:54.462011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:13:54.462011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:13:54.462011 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 429/884] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:13:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:54.467069 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a8a81-ed0b-4a10-af75-1cf49c0f9c9e None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:54.482932 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:54.568595 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a8a81-ed0b-4a10-af75-1cf49c0f9c9e None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:54.603192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb11f52-a9e1-4245-9c37-ced9df037cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:54.603831 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb11f52-a9e1-4245-9c37-ced9df037cfd None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:54.604108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb11f52-a9e1-4245-9c37-ced9df037cfd None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:54.604376 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb11f52-a9e1-4245-9c37-ced9df037cfd None admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:54.605060 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb11f52-a9e1-4245-9c37-ced9df037cfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:54.605363 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb11f52-a9e1-4245-9c37-ced9df037cfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:54.606775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb11f52-a9e1-4245-9c37-ced9df037cfd None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:54.615833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 456/885] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:13:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:54.621573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4631c-5a70-4028-b9ee-89b8d2ddb7f7 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:54.688423 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:54.721145 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4631c-5a70-4028-b9ee-89b8d2ddb7f7 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:54.757259 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3520e82-222a-449c-ac99-db4c558d4ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:54.757881 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3520e82-222a-449c-ac99-db4c558d4ca5 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:54.758159 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3520e82-222a-449c-ac99-db4c558d4ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:54.758425 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3520e82-222a-449c-ac99-db4c558d4ca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:54.768429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3520e82-222a-449c-ac99-db4c558d4ca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:54.770222 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3520e82-222a-449c-ac99-db4c558d4ca5 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:54.786182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-b3520e82-222a-449c-ac99-db4c558d4ca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:54.786182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:54.786182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:54.786182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:54.786182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:54.786182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:54.786182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:54.786182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:54.786182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:54.786182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:54.786182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:54.786182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:54.786182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:13:54.786182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:13:54.786182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:13:54.786182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:54.787319 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:13:54.788429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:13:54.788429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:54.788429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:13:54.788429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 430/886] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:54.793303 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb11f52-a9e1-4245-9c37-ced9df037cfd None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:54.871737 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:54.893909 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb11f52-a9e1-4245-9c37-ced9df037cfd None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:54.937189 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869177d-da40-4297-8b1f-a219b011e3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:54.937847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869177d-da40-4297-8b1f-a219b011e3dc None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:54.938128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869177d-da40-4297-8b1f-a219b011e3dc None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:54.938393 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869177d-da40-4297-8b1f-a219b011e3dc None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:54.939018 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869177d-da40-4297-8b1f-a219b011e3dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:54.939334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869177d-da40-4297-8b1f-a219b011e3dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:54.941009 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869177d-da40-4297-8b1f-a219b011e3dc None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:54.952637 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 457/887] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:54.959019 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3520e82-222a-449c-ac99-db4c558d4ca5 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:55.061106 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3520e82-222a-449c-ac99-db4c558d4ca5 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:55.081157 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:55.094709 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed20dc1-8c83-47f0-86d5-682b92f44675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:55.095334 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed20dc1-8c83-47f0-86d5-682b92f44675 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:55.095612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed20dc1-8c83-47f0-86d5-682b92f44675 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:55.095879 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed20dc1-8c83-47f0-86d5-682b92f44675 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:55.103970 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed20dc1-8c83-47f0-86d5-682b92f44675 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:55.105453 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed20dc1-8c83-47f0-86d5-682b92f44675 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:55.117458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-3ed20dc1-8c83-47f0-86d5-682b92f44675 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 01:13:55.117458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:55.117458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:55.117458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:55.117458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:55.117458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:55.117458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:55.117458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:55.117458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:55.117458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:55.117458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:55.117458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:55.117458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:13:55.117458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:13:55.117458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:13:55.117458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:55.118600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:55.119535 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:55.119535 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:55.119535 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:13:55.119535 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:13:55.119535 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:13:55.119535 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:13:55.119535 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:13:55.119535 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:13:55.119535 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 01:13:55.119535 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:13:55.119535 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 431/888] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:55.124552 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869177d-da40-4297-8b1f-a219b011e3dc None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:55.227533 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869177d-da40-4297-8b1f-a219b011e3dc None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:55.263142 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a71e6-b656-40d2-a031-69d841df63dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:55.263750 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a71e6-b656-40d2-a031-69d841df63dc None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:55.264052 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a71e6-b656-40d2-a031-69d841df63dc None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:55.264330 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a71e6-b656-40d2-a031-69d841df63dc None admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:55.265078 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a71e6-b656-40d2-a031-69d841df63dc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:55.265392 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a71e6-b656-40d2-a031-69d841df63dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:55.266813 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a71e6-b656-40d2-a031-69d841df63dc None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:55.271367 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:55.289437 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 458/889] 10.222.0.82 () {56 vars in 1143 bytes} [Fri Aug 19 01:13:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:55.295158 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed20dc1-8c83-47f0-86d5-682b92f44675 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:55.398034 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed20dc1-8c83-47f0-86d5-682b92f44675 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:55.431629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d887f8b-b3ae-49b0-8388-c81d1f24617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:55.432280 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d887f8b-b3ae-49b0-8388-c81d1f24617a None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:55.432562 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d887f8b-b3ae-49b0-8388-c81d1f24617a None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:55.432835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d887f8b-b3ae-49b0-8388-c81d1f24617a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:55.443386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d887f8b-b3ae-49b0-8388-c81d1f24617a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:55.444824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d887f8b-b3ae-49b0-8388-c81d1f24617a None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:55.459388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-3d887f8b-b3ae-49b0-8388-c81d1f24617a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:55.459388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:55.459388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:55.459388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:55.459388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:55.459388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:55.459388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:55.459388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:55.459388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:55.459388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:55.459388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:55.459388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:55.459388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:13:55.459388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:13:55.459388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:13:55.459388 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:55.460475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:13:55.461717 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:13:55.461717 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:55.461717 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:13:55.461717 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 432/890] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:55.466314 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a71e6-b656-40d2-a031-69d841df63dc None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:55.568195 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a71e6-b656-40d2-a031-69d841df63dc None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:55.602861 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebd556-1884-4588-985d-a35a89b88d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:55.603458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebd556-1884-4588-985d-a35a89b88d62 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:55.603739 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebd556-1884-4588-985d-a35a89b88d62 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:55.604164 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebd556-1884-4588-985d-a35a89b88d62 None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:55.604875 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ebd556-1884-4588-985d-a35a89b88d62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:55.605222 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ebd556-1884-4588-985d-a35a89b88d62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:55.606585 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ebd556-1884-4588-985d-a35a89b88d62 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:55.618518 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 459/891] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:55.624300 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d887f8b-b3ae-49b0-8388-c81d1f24617a None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:55.657797 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:55.730769 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d887f8b-b3ae-49b0-8388-c81d1f24617a None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:55.766021 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870581a-2980-4634-8934-5dffb5b2f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:55.766781 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870581a-2980-4634-8934-5dffb5b2f295 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:55.767266 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870581a-2980-4634-8934-5dffb5b2f295 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:55.767619 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870581a-2980-4634-8934-5dffb5b2f295 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:55.774936 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870581a-2980-4634-8934-5dffb5b2f295 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:55.776381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870581a-2980-4634-8934-5dffb5b2f295 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:55.788379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-8870581a-2980-4634-8934-5dffb5b2f295 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:13:55.788379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:55.788379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:55.788379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:55.788379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:55.788379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:55.788379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:55.788379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:55.788379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:55.788379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:55.788379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:55.788379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:55.788379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:13:55.788379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:13:55.788379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:55.789411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:55.790503 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:13:55.790503 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:13:55.790503 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:13:55.790503 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:13:55.790503 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:13:55.790503 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:13:55.790503 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:13:55.790503 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:13:55.790503 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 433/892] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:13:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:55.795338 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebd556-1884-4588-985d-a35a89b88d62 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:55.849662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:55.897529 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebd556-1884-4588-985d-a35a89b88d62 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:55.930618 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0b660-ed26-440b-bacf-cb66bc8f3f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:55.931153 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0b660-ed26-440b-bacf-cb66bc8f3f03 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:55.931465 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0b660-ed26-440b-bacf-cb66bc8f3f03 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:55.931746 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0b660-ed26-440b-bacf-cb66bc8f3f03 None admin] PATH_INFO: `/v3/projects` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:55.932622 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0b660-ed26-440b-bacf-cb66bc8f3f03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:55.933119 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0b660-ed26-440b-bacf-cb66bc8f3f03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:55.935435 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0b660-ed26-440b-bacf-cb66bc8f3f03 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:55.947139 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 460/893] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:13:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:13:55.953155 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870581a-2980-4634-8934-5dffb5b2f295 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:56.046951 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:56.055785 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870581a-2980-4634-8934-5dffb5b2f295 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:56.088646 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec2513-d695-409c-8f46-4687cc917407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:56.089335 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec2513-d695-409c-8f46-4687cc917407 None admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:56.089615 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec2513-d695-409c-8f46-4687cc917407 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:56.089889 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec2513-d695-409c-8f46-4687cc917407 None admin] PATH_INFO: `/v3/projects/b38e380f92824682a8286e59af2fc23c/users/246b63ecc51347f08daad24d75e3de27/roles/fda5389edef24d6baac46d87242d285b` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:56.091804 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec2513-d695-409c-8f46-4687cc917407 None admin] RBAC: Authorizing `identity:create_grant(project_id=b38e380f92824682a8286e59af2fc23c, user_id=246b63ecc51347f08daad24d75e3de27, role_id=fda5389edef24d6baac46d87242d285b)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:56.093309 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec2513-d695-409c-8f46-4687cc917407 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:56.195821 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 434/894] 10.222.0.82 () {58 vars in 1439 bytes} [Fri Aug 19 01:13:55 2022] PUT /identity/v3/projects/b38e380f92824682a8286e59af2fc23c/users/246b63ecc51347f08daad24d75e3de27/roles/fda5389edef24d6baac46d87242d285b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:13:58.380704 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3b4c0-b7ca-4715-9a47-9e87076d4660 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:58.381291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3b4c0-b7ca-4715-9a47-9e87076d4660 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:58.381291 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3b4c0-b7ca-4715-9a47-9e87076d4660 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:58.382624 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 461/895] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:13:58.387929 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11ed8-1264-4ba0-8f02-3d8074ae6e16 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:58.388348 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11ed8-1264-4ba0-8f02-3d8074ae6e16 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:58.388504 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11ed8-1264-4ba0-8f02-3d8074ae6e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:58.407205 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-1bd11ed8-1264-4ba0-8f02-3d8074ae6e16 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:13:58.408429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-1bd11ed8-1264-4ba0-8f02-3d8074ae6e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:13:58.475638 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 435/896] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:13:58 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:13:58.812026 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3b4c0-b7ca-4715-9a47-9e87076d4660 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:58.915332 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3b4c0-b7ca-4715-9a47-9e87076d4660 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:58.929475 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:58.949285 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20ab0f-678f-4822-bd85-013d2e6ecd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:58.949910 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20ab0f-678f-4822-bd85-013d2e6ecd0b None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:58.950189 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20ab0f-678f-4822-bd85-013d2e6ecd0b None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:58.950458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20ab0f-678f-4822-bd85-013d2e6ecd0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:58.960922 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20ab0f-678f-4822-bd85-013d2e6ecd0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 01:13:58.965671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-6d20ab0f-678f-4822-bd85-013d2e6ecd0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:13:58.965671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:58.965671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:58.965671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:58.965671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:58.965671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:58.965671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:58.965671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:58.965671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:58.965671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:58.965671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:58.965671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:58.965671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 01:13:58.965671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 01:13:58.965671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 01:13:58.965671 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 01:13:58.972974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 01:13:58.972974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 01:13:58.972974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 01:13:58.972974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 01:13:58.972974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:58.972974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:58.972974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:58.972974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:58.972974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:58.972974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:58.972974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:58.972974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:58.972974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:58.972974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:58.972974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:58.972974 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:58.973855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:58.973855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:58.973855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:58.973855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:58.973855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 01:13:58.973855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 01:13:58.973855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 01:13:58.973855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 01:13:58.973855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 01:13:58.973855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 01:13:58.973855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 01:13:58.973855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:13:58.973855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 462/897] 10.222.0.82 () {56 vars in 1096 bytes} [Fri Aug 19 01:13:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:58.974557 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd11ed8-1264-4ba0-8f02-3d8074ae6e16 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:59.060727 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:59.078410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd11ed8-1264-4ba0-8f02-3d8074ae6e16 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:59.111897 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c475b8-3a22-40ae-8ed7-31176530b593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:59.112671 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c475b8-3a22-40ae-8ed7-31176530b593 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:59.112979 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c475b8-3a22-40ae-8ed7-31176530b593 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:59.113249 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c475b8-3a22-40ae-8ed7-31176530b593 None admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:59.113905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c475b8-3a22-40ae-8ed7-31176530b593 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:59.114207 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c475b8-3a22-40ae-8ed7-31176530b593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:59.115662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c475b8-3a22-40ae-8ed7-31176530b593 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:59.123402 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 436/898] 10.222.0.82 () {56 vars in 1099 bytes} [Fri Aug 19 01:13:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:59.129348 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20ab0f-678f-4822-bd85-013d2e6ecd0b None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:59.229631 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20ab0f-678f-4822-bd85-013d2e6ecd0b None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:59.264261 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f35da7-fc37-45d8-8a96-be34f9c598d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:59.264902 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f35da7-fc37-45d8-8a96-be34f9c598d4 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:59.265180 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f35da7-fc37-45d8-8a96-be34f9c598d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:59.265444 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f35da7-fc37-45d8-8a96-be34f9c598d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:59.276201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f35da7-fc37-45d8-8a96-be34f9c598d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:59.277749 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f35da7-fc37-45d8-8a96-be34f9c598d4 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:59.292296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-15f35da7-fc37-45d8-8a96-be34f9c598d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:59.292296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:59.292296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:59.292296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:59.292296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:59.292296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:59.292296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:59.292296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:59.292296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:59.292296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:59.292296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:59.292296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:59.292296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:13:59.292296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:13:59.292296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:13:59.292296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:59.293447 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:13:59.294348 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:13:59.294348 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:13:59.294348 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:13:59.294348 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 463/899] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:59.299302 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c475b8-3a22-40ae-8ed7-31176530b593 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:59.403913 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c475b8-3a22-40ae-8ed7-31176530b593 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:59.438167 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dcd7c-6255-42ce-92f8-f739fbaef624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:59.438776 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dcd7c-6255-42ce-92f8-f739fbaef624 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:59.439070 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dcd7c-6255-42ce-92f8-f739fbaef624 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:59.439379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dcd7c-6255-42ce-92f8-f739fbaef624 None admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:59.439988 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dcd7c-6255-42ce-92f8-f739fbaef624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:59.440263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dcd7c-6255-42ce-92f8-f739fbaef624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:59.444062 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dcd7c-6255-42ce-92f8-f739fbaef624 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:59.454198 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 437/900] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:59.461168 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f35da7-fc37-45d8-8a96-be34f9c598d4 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:59.488213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:59.559869 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f35da7-fc37-45d8-8a96-be34f9c598d4 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:59.594634 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9deb73-3124-4cd2-a192-5bb8bb40e105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:59.595276 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9deb73-3124-4cd2-a192-5bb8bb40e105 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:59.595553 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9deb73-3124-4cd2-a192-5bb8bb40e105 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:59.599436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9deb73-3124-4cd2-a192-5bb8bb40e105 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:59.603259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9deb73-3124-4cd2-a192-5bb8bb40e105 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:59.604678 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9deb73-3124-4cd2-a192-5bb8bb40e105 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:59.616074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-8d9deb73-3124-4cd2-a192-5bb8bb40e105 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 01:13:59.616074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:13:59.616074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:13:59.616074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:13:59.616074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:13:59.616074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:13:59.616074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:13:59.616074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:13:59.616074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:13:59.616074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:13:59.616074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:13:59.616074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:13:59.616074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 01:13:59.616074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 01:13:59.616074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 01:13:59.616074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:13:59.617305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:13:59.618472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:13:59.618472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:13:59.618472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 01:13:59.618472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 01:13:59.618472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 01:13:59.618472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 01:13:59.618472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 01:13:59.618472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 01:13:59.618472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 01:13:59.618472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:13:59.618472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 464/901] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:13:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:13:59.623115 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dcd7c-6255-42ce-92f8-f739fbaef624 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:59.627111 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:59.723082 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dcd7c-6255-42ce-92f8-f739fbaef624 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:59.758261 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef872d6a-2ff9-43a9-aef1-234f7531826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:59.758871 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef872d6a-2ff9-43a9-aef1-234f7531826d None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:59.762885 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef872d6a-2ff9-43a9-aef1-234f7531826d None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:59.762885 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef872d6a-2ff9-43a9-aef1-234f7531826d None admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:59.762885 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef872d6a-2ff9-43a9-aef1-234f7531826d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:13:59.762885 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef872d6a-2ff9-43a9-aef1-234f7531826d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:59.762885 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef872d6a-2ff9-43a9-aef1-234f7531826d None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:13:59.779501 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 438/902] 10.222.0.82 () {56 vars in 1143 bytes} [Fri Aug 19 01:13:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:13:59.785589 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9deb73-3124-4cd2-a192-5bb8bb40e105 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:13:59.870019 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:13:59.884813 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9deb73-3124-4cd2-a192-5bb8bb40e105 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:13:59.916870 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d1319-2a9b-4b0f-83d8-4fd5606977cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:13:59.917488 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d1319-2a9b-4b0f-83d8-4fd5606977cf None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:13:59.917761 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d1319-2a9b-4b0f-83d8-4fd5606977cf None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:13:59.918031 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d1319-2a9b-4b0f-83d8-4fd5606977cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:13:59.986404 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d1319-2a9b-4b0f-83d8-4fd5606977cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:13:59.988686 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d1319-2a9b-4b0f-83d8-4fd5606977cf None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:00.073925 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:14:00.088657 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 465/903] 10.222.0.82 () {58 vars in 1282 bytes} [Fri Aug 19 01:13:59 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 01:14:00.094578 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef872d6a-2ff9-43a9-aef1-234f7531826d None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:14:00.164771 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:14:00.203736 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef872d6a-2ff9-43a9-aef1-234f7531826d None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:14:00.238321 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a5a58-35f8-4f42-ad4b-77d5e32a20d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:14:00.238930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a5a58-35f8-4f42-ad4b-77d5e32a20d9 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:00.239212 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a5a58-35f8-4f42-ad4b-77d5e32a20d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:00.239485 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a5a58-35f8-4f42-ad4b-77d5e32a20d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:00.249915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a5a58-35f8-4f42-ad4b-77d5e32a20d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:14:00.251400 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a5a58-35f8-4f42-ad4b-77d5e32a20d9 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:00.265234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-852a5a58-35f8-4f42-ad4b-77d5e32a20d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:14:00.265234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:14:00.265234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:14:00.265234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:14:00.265234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:14:00.265234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:14:00.265234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:14:00.265234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:14:00.265234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:14:00.265234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:14:00.265234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:14:00.265234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:14:00.265234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 01:14:00.265234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 01:14:00.265234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 01:14:00.265234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:14:00.269956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 01:14:00.270859 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 01:14:00.270859 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 01:14:00.270859 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:14:00.270859 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 439/904] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:14:00.272393 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d1319-2a9b-4b0f-83d8-4fd5606977cf None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:14:00.371763 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d1319-2a9b-4b0f-83d8-4fd5606977cf None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:14:00.405563 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd227b-68e8-4213-9bb3-49c04ba7571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:14:00.406160 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd227b-68e8-4213-9bb3-49c04ba7571d None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:00.406436 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd227b-68e8-4213-9bb3-49c04ba7571d None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:00.406704 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd227b-68e8-4213-9bb3-49c04ba7571d None admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:00.407330 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd227b-68e8-4213-9bb3-49c04ba7571d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:14:00.407628 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd227b-68e8-4213-9bb3-49c04ba7571d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:14:00.409016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd227b-68e8-4213-9bb3-49c04ba7571d None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:00.420723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 466/905] 10.222.0.82 () {56 vars in 1109 bytes} [Fri Aug 19 01:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:14:00.427113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a5a58-35f8-4f42-ad4b-77d5e32a20d9 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:14:00.531142 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a5a58-35f8-4f42-ad4b-77d5e32a20d9 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:14:00.547449 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:14:00.571206 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c6189-c367-4673-90dd-8225d11478e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:14:00.572082 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c6189-c367-4673-90dd-8225d11478e5 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:00.572328 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c6189-c367-4673-90dd-8225d11478e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:00.572557 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c6189-c367-4673-90dd-8225d11478e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:00.580378 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c6189-c367-4673-90dd-8225d11478e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:14:00.582083 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c6189-c367-4673-90dd-8225d11478e5 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:00.594544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application [None req-bd4c6189-c367-4673-90dd-8225d11478e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:14:00.594544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:14:00.594544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:14:00.594544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:14:00.594544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:14:00.594544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:14:00.594544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:14:00.594544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:14:00.594544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:14:00.594544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:14:00.594544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:14:00.594544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:14:00.594544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 01:14:00.594544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 01:14:00.594544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application with Lock( Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:14:00.595698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:14:00.596604 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 01:14:00.596604 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 01:14:00.596604 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 01:14:00.596604 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 01:14:00.596604 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 01:14:00.596604 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 01:14:00.596604 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 01:14:00.596604 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: ERROR keystone.server.flask.application Aug 19 01:14:00.596604 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 440/906] 10.222.0.82 () {56 vars in 1111 bytes} [Fri Aug 19 01:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:14:00.603073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd227b-68e8-4213-9bb3-49c04ba7571d None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:14:00.658263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:14:00.717158 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd227b-68e8-4213-9bb3-49c04ba7571d None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:14:00.753846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dfc3e-c466-4b37-9ebc-6f2f9e648d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:14:00.754475 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dfc3e-c466-4b37-9ebc-6f2f9e648d43 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:00.754756 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dfc3e-c466-4b37-9ebc-6f2f9e648d43 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:00.755024 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dfc3e-c466-4b37-9ebc-6f2f9e648d43 None admin] PATH_INFO: `/v3/projects` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:00.755750 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dfc3e-c466-4b37-9ebc-6f2f9e648d43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:14:00.756054 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dfc3e-c466-4b37-9ebc-6f2f9e648d43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:14:00.757648 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dfc3e-c466-4b37-9ebc-6f2f9e648d43 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:00.772125 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 467/907] 10.222.0.82 () {56 vars in 1148 bytes} [Fri Aug 19 01:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:14:00.778752 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c6189-c367-4673-90dd-8225d11478e5 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:14:00.895164 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c6189-c367-4673-90dd-8225d11478e5 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:14:00.930676 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d139b-a3e1-491f-a70a-400a3cc366d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:14:00.931361 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d139b-a3e1-491f-a70a-400a3cc366d3 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:00.931608 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d139b-a3e1-491f-a70a-400a3cc366d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:00.931882 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d139b-a3e1-491f-a70a-400a3cc366d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:00.932644 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d139b-a3e1-491f-a70a-400a3cc366d3 None admin] RBAC: Adding query filter params (role.id=fda5389edef24d6baac46d87242d285b, scope.project.id=b38e380f92824682a8286e59af2fc23c, user.id=246b63ecc51347f08daad24d75e3de27) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:14:00.932987 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d139b-a3e1-491f-a70a-400a3cc366d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:14:00.934427 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d139b-a3e1-491f-a70a-400a3cc366d3 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:00.940284 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 441/908] 10.222.0.82 () {56 vars in 1374 bytes} [Fri Aug 19 01:14:00 2022] GET /identity/v3/role_assignments?user.id=246b63ecc51347f08daad24d75e3de27&scope.project.id=b38e380f92824682a8286e59af2fc23c&role.id=fda5389edef24d6baac46d87242d285b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:14:03.163122 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f520117-ee35-47a2-8824-60a6bf65c70e None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:03.163741 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f520117-ee35-47a2-8824-60a6bf65c70e None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:03.163741 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f520117-ee35-47a2-8824-60a6bf65c70e None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:03.165058 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 468/909] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:14:03.170459 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a150d-3d40-454d-b72b-d86be00c2be4 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:03.172945 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a150d-3d40-454d-b72b-d86be00c2be4 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:03.172945 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a150d-3d40-454d-b72b-d86be00c2be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:03.189173 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-4a2a150d-3d40-454d-b72b-d86be00c2be4 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:14:03.195824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-4a2a150d-3d40-454d-b72b-d86be00c2be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:14:03.220382 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:14:03.256995 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 442/910] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:14:03 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:14:03.587132 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f520117-ee35-47a2-8824-60a6bf65c70e None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:14:03.689105 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f520117-ee35-47a2-8824-60a6bf65c70e None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:14:03.696928 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:14:03.722917 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1313b-d767-4b88-a3fb-70a1454da66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:14:03.723534 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1313b-d767-4b88-a3fb-70a1454da66d None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:03.723812 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1313b-d767-4b88-a3fb-70a1454da66d None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:03.724083 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1313b-d767-4b88-a3fb-70a1454da66d None admin] PATH_INFO: `/v3/services/placement` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:03.724681 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1313b-d767-4b88-a3fb-70a1454da66d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:14:03.726076 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1313b-d767-4b88-a3fb-70a1454da66d None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-d3d1313b-d767-4b88-a3fb-70a1454da66d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:14:03.734515 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:14:03.735717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:14:03.735717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:14:03.735717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:14:03.735717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:14:03.735717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:14:03.735717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:14:03.735717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:14:03.735717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:14:03.735717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:14:03.735717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:14:03.735717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:14:03.735717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:14:03.735717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:14:03.735717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:14:03.735717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:14:03.735717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:14:03.736644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:14:03.736644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:14:03.736644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:14:03.736644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:14:03.736644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:14:03.736644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:14:03.736644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:14:03.736644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:14:03.736644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:14:03.736644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:14:03.736644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:14:03.736644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:14:03.736644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 01:14:03.736644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:14:03.736644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 469/911] 10.222.0.82 () {56 vars in 1117 bytes} [Fri Aug 19 01:14:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 01:14:03.742490 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a150d-3d40-454d-b72b-d86be00c2be4 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:14:03.840589 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a150d-3d40-454d-b72b-d86be00c2be4 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:14:03.874187 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ab3b6-a7b8-460c-8b95-c89a293762e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:14:03.874784 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ab3b6-a7b8-460c-8b95-c89a293762e6 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:03.875090 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ab3b6-a7b8-460c-8b95-c89a293762e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:03.875362 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ab3b6-a7b8-460c-8b95-c89a293762e6 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:03.875978 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ab3b6-a7b8-460c-8b95-c89a293762e6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:14:03.876283 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ab3b6-a7b8-460c-8b95-c89a293762e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:14:03.877680 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ab3b6-a7b8-460c-8b95-c89a293762e6 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:03.882590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 443/912] 10.222.0.82 () {56 vars in 1116 bytes} [Fri Aug 19 01:14:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:14:03.888522 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1313b-d767-4b88-a3fb-70a1454da66d None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:14:03.986845 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1313b-d767-4b88-a3fb-70a1454da66d None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:14:04.021334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becffb71-3ea1-4143-95f9-4edb0d3883b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:14:04.021930 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becffb71-3ea1-4143-95f9-4edb0d3883b2 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:04.022204 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becffb71-3ea1-4143-95f9-4edb0d3883b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:04.022470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becffb71-3ea1-4143-95f9-4edb0d3883b2 None admin] PATH_INFO: `/v3/services` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:04.023343 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becffb71-3ea1-4143-95f9-4edb0d3883b2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:14:04.023640 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becffb71-3ea1-4143-95f9-4edb0d3883b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:14:04.025014 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becffb71-3ea1-4143-95f9-4edb0d3883b2 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:04.029239 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 470/913] 10.222.0.82 () {56 vars in 1116 bytes} [Fri Aug 19 01:14:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:14:06.228153 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f406108-0e8b-465b-8f93-beed7344eecc None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:06.228707 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f406108-0e8b-465b-8f93-beed7344eecc None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:06.228707 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f406108-0e8b-465b-8f93-beed7344eecc None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:06.230057 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 444/914] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:14:06.235329 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eeffe-8522-4d35-bc44-3aecd2914e0a None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:06.235764 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eeffe-8522-4d35-bc44-3aecd2914e0a None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:06.235870 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eeffe-8522-4d35-bc44-3aecd2914e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:06.254118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-7e6eeffe-8522-4d35-bc44-3aecd2914e0a None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:14:06.255282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-7e6eeffe-8522-4d35-bc44-3aecd2914e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:14:06.281441 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:14:06.320214 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 471/915] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:14:06 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:14:06.660658 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f406108-0e8b-465b-8f93-beed7344eecc None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:14:06.693600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:14:06.764326 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f406108-0e8b-465b-8f93-beed7344eecc None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:14:06.798564 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a43f8-ec27-4331-abbe-3de94414f0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:14:06.799216 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a43f8-ec27-4331-abbe-3de94414f0c2 None admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:06.799493 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a43f8-ec27-4331-abbe-3de94414f0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:06.799790 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a43f8-ec27-4331-abbe-3de94414f0c2 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:06.800431 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a43f8-ec27-4331-abbe-3de94414f0c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:14:06.801891 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a43f8-ec27-4331-abbe-3de94414f0c2 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:06.905296 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 445/916] 10.222.0.82 () {60 vars in 1141 bytes} [Fri Aug 19 01:14:06 2022] POST /identity/v3/services => generated 246 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:14:09.113089 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc3f93-1a2a-4700-888b-f39e774e121b None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:09.113657 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc3f93-1a2a-4700-888b-f39e774e121b None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:09.113657 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc3f93-1a2a-4700-888b-f39e774e121b None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:09.115020 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 472/917] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:14:09.120086 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0cced-da23-49f2-8ad9-aaa95dc31bc8 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:09.120524 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0cced-da23-49f2-8ad9-aaa95dc31bc8 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:09.120716 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0cced-da23-49f2-8ad9-aaa95dc31bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:09.139014 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-efa0cced-da23-49f2-8ad9-aaa95dc31bc8 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:14:09.140197 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-efa0cced-da23-49f2-8ad9-aaa95dc31bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:14:09.212430 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 446/918] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:14:09 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:14:09.558185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc3f93-1a2a-4700-888b-f39e774e121b None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:14:09.661865 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc3f93-1a2a-4700-888b-f39e774e121b None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:14:09.694958 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904cbfd-919e-44f7-8d33-0a351c539958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:14:09.695576 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904cbfd-919e-44f7-8d33-0a351c539958 None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:09.695854 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904cbfd-919e-44f7-8d33-0a351c539958 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:09.696124 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904cbfd-919e-44f7-8d33-0a351c539958 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:09.696697 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904cbfd-919e-44f7-8d33-0a351c539958 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:14:09.698160 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904cbfd-919e-44f7-8d33-0a351c539958 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-b904cbfd-919e-44f7-8d33-0a351c539958 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:14:09.707470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:14:09.708683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:14:09.708683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:14:09.708683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:14:09.708683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:14:09.708683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:14:09.708683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:14:09.708683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:14:09.708683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:14:09.708683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:14:09.708683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:14:09.708683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:14:09.708683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:14:09.708683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:14:09.708683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:14:09.708683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:14:09.708683 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:14:09.709556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:14:09.709556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:14:09.709556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:14:09.709556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:14:09.709556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:14:09.709556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:14:09.709556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:14:09.709556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:14:09.709556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:14:09.709556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:14:09.709556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:14:09.709556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:14:09.709556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 01:14:09.709556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:14:09.709556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 473/919] 10.222.0.82 () {56 vars in 1117 bytes} [Fri Aug 19 01:14:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:14:09.714751 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0cced-da23-49f2-8ad9-aaa95dc31bc8 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:14:09.732985 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:14:09.811437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0cced-da23-49f2-8ad9-aaa95dc31bc8 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:14:09.846449 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986019ce-e3c0-4eee-8181-21d2204affd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:14:09.847622 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986019ce-e3c0-4eee-8181-21d2204affd2 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:09.847900 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986019ce-e3c0-4eee-8181-21d2204affd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:09.848171 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986019ce-e3c0-4eee-8181-21d2204affd2 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:09.848794 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986019ce-e3c0-4eee-8181-21d2204affd2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:14:09.849129 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986019ce-e3c0-4eee-8181-21d2204affd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:14:09.850501 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986019ce-e3c0-4eee-8181-21d2204affd2 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:09.856390 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 447/920] 10.222.0.82 () {56 vars in 1116 bytes} [Fri Aug 19 01:14:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:14:09.862637 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904cbfd-919e-44f7-8d33-0a351c539958 None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:14:09.892978 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:14:09.966441 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904cbfd-919e-44f7-8d33-0a351c539958 None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:14:09.998684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba632da4-58d5-45b0-9ff4-bf0b3e7460de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:14:09.999282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba632da4-58d5-45b0-9ff4-bf0b3e7460de None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:09.999562 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba632da4-58d5-45b0-9ff4-bf0b3e7460de None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:09.999835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba632da4-58d5-45b0-9ff4-bf0b3e7460de None admin] PATH_INFO: `/v3/endpoints` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:10.000559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba632da4-58d5-45b0-9ff4-bf0b3e7460de None admin] RBAC: Adding query filter params (interface=public, service_id=5d1588715ea643149de68aa0118e5d21, region_id=RegionOne) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:14:10.000886 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba632da4-58d5-45b0-9ff4-bf0b3e7460de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:14:10.002243 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba632da4-58d5-45b0-9ff4-bf0b3e7460de None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:10.007843 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 474/921] 10.222.0.82 () {56 vars in 1251 bytes} [Fri Aug 19 01:14:09 2022] GET /identity/v3/endpoints?service_id=5d1588715ea643149de68aa0118e5d21&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:14:10.013820 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986019ce-e3c0-4eee-8181-21d2204affd2 None admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:14:10.096341 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:14:10.114396 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986019ce-e3c0-4eee-8181-21d2204affd2 None admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:14:10.149862 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f3bef-0941-4ceb-bb9e-892c51203a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:14:10.150474 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f3bef-0941-4ceb-bb9e-892c51203a99 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:10.150718 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f3bef-0941-4ceb-bb9e-892c51203a99 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:10.150984 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f3bef-0941-4ceb-bb9e-892c51203a99 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:10.151575 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f3bef-0941-4ceb-bb9e-892c51203a99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:14:10.152981 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f3bef-0941-4ceb-bb9e-892c51203a99 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:10.159806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 448/922] 10.222.0.82 () {56 vars in 1087 bytes} [Fri Aug 19 01:14:10 2022] GET /identity/v3/services => generated 1962 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:14:12.376131 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23281631-42ad-438f-9723-37d5c157d781 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:12.376672 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23281631-42ad-438f-9723-37d5c157d781 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:12.376767 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23281631-42ad-438f-9723-37d5c157d781 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:12.378278 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 475/923] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:14:12.383332 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127bc88-2572-44a8-a26b-eb6da324eef1 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:12.383747 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127bc88-2572-44a8-a26b-eb6da324eef1 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:12.383878 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127bc88-2572-44a8-a26b-eb6da324eef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:12.402542 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-2127bc88-2572-44a8-a26b-eb6da324eef1 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:14:12.403726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-2127bc88-2572-44a8-a26b-eb6da324eef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:14:12.469709 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 449/924] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:14:12 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 01:14:12.791400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23281631-42ad-438f-9723-37d5c157d781 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:14:12.882242 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:14:12.891639 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23281631-42ad-438f-9723-37d5c157d781 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:14:12.928552 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cfcb4-9f4c-463c-ad14-af9dd39c8e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:14:12.929208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cfcb4-9f4c-463c-ad14-af9dd39c8e7f None admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:12.929484 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cfcb4-9f4c-463c-ad14-af9dd39c8e7f None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:12.929751 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cfcb4-9f4c-463c-ad14-af9dd39c8e7f None admin] PATH_INFO: `/v3/services/placement` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:12.930322 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cfcb4-9f4c-463c-ad14-af9dd39c8e7f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:14:12.931687 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cfcb4-9f4c-463c-ad14-af9dd39c8e7f None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application [None req-216cfcb4-9f4c-463c-ad14-af9dd39c8e7f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 01:14:12.941234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 01:14:12.942407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 01:14:12.942407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 01:14:12.942407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 01:14:12.942407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 01:14:12.942407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 01:14:12.942407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 01:14:12.942407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 01:14:12.942407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 01:14:12.942407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 01:14:12.942407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 01:14:12.942407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 01:14:12.942407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 01:14:12.942407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 01:14:12.942407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 01:14:12.942407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 01:14:12.942407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 01:14:12.943528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 01:14:12.943528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application with Lock( Aug 19 01:14:12.943528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 01:14:12.943528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self._enter() Aug 19 01:14:12.943528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 01:14:12.943528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 01:14:12.943528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 01:14:12.943528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application return self.creator() Aug 19 01:14:12.943528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 01:14:12.943528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application created_value = creator( Aug 19 01:14:12.943528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 01:14:12.943528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 01:14:12.943528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 01:14:12.943528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: ERROR keystone.server.flask.application Aug 19 01:14:12.943528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 476/925] 10.222.0.82 () {56 vars in 1117 bytes} [Fri Aug 19 01:14:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 01:14:12.948417 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127bc88-2572-44a8-a26b-eb6da324eef1 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:14:13.022897 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:14:13.044722 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127bc88-2572-44a8-a26b-eb6da324eef1 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:14:13.077566 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24b372-a2ba-4c73-b596-b9b2ef651b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:14:13.078155 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24b372-a2ba-4c73-b596-b9b2ef651b24 None admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:13.078430 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24b372-a2ba-4c73-b596-b9b2ef651b24 None admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:13.078695 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24b372-a2ba-4c73-b596-b9b2ef651b24 None admin] PATH_INFO: `/v3/services` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:13.079301 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24b372-a2ba-4c73-b596-b9b2ef651b24 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:14:13.079595 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24b372-a2ba-4c73-b596-b9b2ef651b24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:14:13.081651 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24b372-a2ba-4c73-b596-b9b2ef651b24 None admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:13.086664 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 450/926] 10.222.0.82 () {56 vars in 1116 bytes} [Fri Aug 19 01:14:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:14:13.092471 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cfcb4-9f4c-463c-ad14-af9dd39c8e7f None admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:14:13.191225 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cfcb4-9f4c-463c-ad14-af9dd39c8e7f None admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:14:13.222995 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcdcb3-c36e-494a-a2fe-b17108185472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:14:13.223584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcdcb3-c36e-494a-a2fe-b17108185472 None admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:14:13.223858 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcdcb3-c36e-494a-a2fe-b17108185472 None admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:14:13.224122 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcdcb3-c36e-494a-a2fe-b17108185472 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:14:13.224770 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcdcb3-c36e-494a-a2fe-b17108185472 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:14:13.226149 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcdcb3-c36e-494a-a2fe-b17108185472 None admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:14:13.299241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 477/927] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Aug 19 01:14:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:14:23.109821 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=30 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:14:23.294324 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:20:30.263818 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a84d7-9171-4248-86bc-ca454d397d05 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:30.264289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a84d7-9171-4248-86bc-ca454d397d05 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:30.264367 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a84d7-9171-4248-86bc-ca454d397d05 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:30.269208 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 451/928] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:20:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:20:30.271275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b9c6d-5c7b-4cf9-a45f-3705bfb9f00e None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:30.271693 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b9c6d-5c7b-4cf9-a45f-3705bfb9f00e None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:30.271837 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b9c6d-5c7b-4cf9-a45f-3705bfb9f00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:30.381609 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-3d7b9c6d-5c7b-4cf9-a45f-3705bfb9f00e None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:20:30.383620 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-3d7b9c6d-5c7b-4cf9-a45f-3705bfb9f00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:20:30.512306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 478/929] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:20:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:20:30.867803 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d570-2c0e-4f03-afcc-f619bd85d895 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:30.868159 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d570-2c0e-4f03-afcc-f619bd85d895 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:30.868502 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940d570-2c0e-4f03-afcc-f619bd85d895 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:30.870006 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 452/930] 10.222.0.82 () {54 vars in 965 bytes} [Fri Aug 19 01:20:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:20:30.878537 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b96ae-433b-497c-9f2c-8534de5b797e None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:30.878899 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b96ae-433b-497c-9f2c-8534de5b797e None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:30.879240 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b96ae-433b-497c-9f2c-8534de5b797e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:30.939949 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-e62b96ae-433b-497c-9f2c-8534de5b797e None None] MFA Rules not processed for user `51d3ab73e09b4d94b06df7eaf1d8b85e`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:20:30.941198 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-e62b96ae-433b-497c-9f2c-8534de5b797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:20:30.985809 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:20:31.024226 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 479/931] 10.222.0.82 () {58 vars in 1062 bytes} [Fri Aug 19 01:20:30 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:20:31.033683 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940d570-2c0e-4f03-afcc-f619bd85d895 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:20:31.046654 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940d570-2c0e-4f03-afcc-f619bd85d895 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:20:31.050166 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480470b9-9146-4f22-bf04-0b98e1726418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:20:31.050784 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480470b9-9146-4f22-bf04-0b98e1726418 service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:31.051061 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480470b9-9146-4f22-bf04-0b98e1726418 service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:31.051330 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480470b9-9146-4f22-bf04-0b98e1726418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:31.062219 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480470b9-9146-4f22-bf04-0b98e1726418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:20:31.063686 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480470b9-9146-4f22-bf04-0b98e1726418 service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:20:31.075577 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 453/932] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:20:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:20:33.640729 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d52bc-6ce1-4ce1-af95-d472cb4307dc None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:33.641273 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d52bc-6ce1-4ce1-af95-d472cb4307dc None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:33.641351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d52bc-6ce1-4ce1-af95-d472cb4307dc None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:33.642638 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 480/933] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:20:33.648763 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca1e58-eb4f-41bf-b4a8-d90315f98edf None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:33.649297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca1e58-eb4f-41bf-b4a8-d90315f98edf None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:33.649387 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca1e58-eb4f-41bf-b4a8-d90315f98edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:33.671895 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-a4ca1e58-eb4f-41bf-b4a8-d90315f98edf None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:20:33.673149 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-a4ca1e58-eb4f-41bf-b4a8-d90315f98edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:20:33.682358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 454/934] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:20:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:20:34.028669 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d52bc-6ce1-4ce1-af95-d472cb4307dc None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:20:34.039831 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d52bc-6ce1-4ce1-af95-d472cb4307dc None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:20:34.043300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f18758-3ad6-4354-99c3-b5e2326b8d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:20:34.043900 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f18758-3ad6-4354-99c3-b5e2326b8d07 service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:34.044181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f18758-3ad6-4354-99c3-b5e2326b8d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:34.044452 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f18758-3ad6-4354-99c3-b5e2326b8d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:34.053510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f18758-3ad6-4354-99c3-b5e2326b8d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:20:34.055505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f18758-3ad6-4354-99c3-b5e2326b8d07 service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:20:34.065419 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 481/935] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:20:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:20:36.843608 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdc441-789c-4611-9cbf-b44ecf784138 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:36.844144 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdc441-789c-4611-9cbf-b44ecf784138 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:36.844144 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdc441-789c-4611-9cbf-b44ecf784138 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:36.845445 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 455/936] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:20:36.850872 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bed417-e72f-48bf-8876-edaaf94b6ee6 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:36.851455 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bed417-e72f-48bf-8876-edaaf94b6ee6 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:36.851455 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bed417-e72f-48bf-8876-edaaf94b6ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:36.913585 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-74bed417-e72f-48bf-8876-edaaf94b6ee6 None None] MFA Rules not processed for user `6d0e2c6f0e0343118653a302efb265d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:20:36.914770 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-74bed417-e72f-48bf-8876-edaaf94b6ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:20:36.997184 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 482/937] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:20:36 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:20:37.360640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b46680-4ed5-43fb-be6e-54654eef3459 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:37.360984 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b46680-4ed5-43fb-be6e-54654eef3459 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:37.361259 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b46680-4ed5-43fb-be6e-54654eef3459 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:37.362635 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 456/938] 10.222.0.82 () {54 vars in 965 bytes} [Fri Aug 19 01:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:20:37.370107 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad5436-1944-455c-809d-549637e052ca None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:37.370485 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad5436-1944-455c-809d-549637e052ca None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:37.370833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad5436-1944-455c-809d-549637e052ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:37.392077 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-daad5436-1944-455c-809d-549637e052ca None None] MFA Rules not processed for user `51d3ab73e09b4d94b06df7eaf1d8b85e`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:20:37.393426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-daad5436-1944-455c-809d-549637e052ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:20:37.400630 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 483/939] 10.222.0.82 () {58 vars in 1062 bytes} [Fri Aug 19 01:20:37 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:20:37.409795 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b46680-4ed5-43fb-be6e-54654eef3459 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:20:37.421424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b46680-4ed5-43fb-be6e-54654eef3459 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:20:37.424996 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d4c72-519d-4a5a-97fd-cbb87f3d4823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:20:37.425605 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d4c72-519d-4a5a-97fd-cbb87f3d4823 service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:37.425884 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d4c72-519d-4a5a-97fd-cbb87f3d4823 service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:37.426153 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d4c72-519d-4a5a-97fd-cbb87f3d4823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:37.438343 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d4c72-519d-4a5a-97fd-cbb87f3d4823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:20:37.439864 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d4c72-519d-4a5a-97fd-cbb87f3d4823 service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:20:37.451347 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 457/940] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:20:37 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 01:20:40.846598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bc0e8-1db3-4db7-9a68-12c17fb819c2 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:40.847096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bc0e8-1db3-4db7-9a68-12c17fb819c2 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:40.847096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bc0e8-1db3-4db7-9a68-12c17fb819c2 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:40.848382 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 484/941] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:20:40.854002 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55b334-068e-49d0-a89b-40656913edc1 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:40.854374 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55b334-068e-49d0-a89b-40656913edc1 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:40.854555 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55b334-068e-49d0-a89b-40656913edc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:40.875096 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-4b55b334-068e-49d0-a89b-40656913edc1 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:20:40.876278 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-4b55b334-068e-49d0-a89b-40656913edc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:20:40.943269 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 458/942] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:20:40 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:20:41.286116 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bc0e8-1db3-4db7-9a68-12c17fb819c2 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:20:41.297787 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bc0e8-1db3-4db7-9a68-12c17fb819c2 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:20:41.301287 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b6d6d-671e-4368-bf24-7de71774f5ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:20:41.301887 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b6d6d-671e-4368-bf24-7de71774f5ac service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:41.302166 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b6d6d-671e-4368-bf24-7de71774f5ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:41.302439 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b6d6d-671e-4368-bf24-7de71774f5ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:41.311269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b6d6d-671e-4368-bf24-7de71774f5ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:20:41.312709 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b6d6d-671e-4368-bf24-7de71774f5ac service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:20:41.322020 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 485/943] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:20:41 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:20:44.741686 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d991f6c-b590-4a13-9535-a42c74280eb4 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:44.742842 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d991f6c-b590-4a13-9535-a42c74280eb4 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:44.743336 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d991f6c-b590-4a13-9535-a42c74280eb4 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:44.744692 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 459/944] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:20:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:20:44.750016 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e51a15-3e3c-4189-afaa-17dc3a91bd02 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:44.750457 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e51a15-3e3c-4189-afaa-17dc3a91bd02 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:44.750564 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e51a15-3e3c-4189-afaa-17dc3a91bd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:44.769407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-22e51a15-3e3c-4189-afaa-17dc3a91bd02 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:20:44.770588 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-22e51a15-3e3c-4189-afaa-17dc3a91bd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:20:44.778336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 486/945] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:20:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:20:45.123868 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d991f6c-b590-4a13-9535-a42c74280eb4 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:20:45.135306 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d991f6c-b590-4a13-9535-a42c74280eb4 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:20:45.138703 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922bcf3-217e-4bc6-aebb-d4a159a7df17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:20:45.139293 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922bcf3-217e-4bc6-aebb-d4a159a7df17 service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:45.139565 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922bcf3-217e-4bc6-aebb-d4a159a7df17 service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:45.139830 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922bcf3-217e-4bc6-aebb-d4a159a7df17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:45.148963 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922bcf3-217e-4bc6-aebb-d4a159a7df17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:20:45.150526 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922bcf3-217e-4bc6-aebb-d4a159a7df17 service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:20:45.159996 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 460/946] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:20:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:20:47.406736 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3f6c7-cf45-4f3d-9bed-c1aa36888086 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:47.407285 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3f6c7-cf45-4f3d-9bed-c1aa36888086 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:47.407387 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3f6c7-cf45-4f3d-9bed-c1aa36888086 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:47.408694 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 487/947] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:20:47.414532 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e0368-6f56-43c3-bfd8-882a3fa9c92e None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:47.415044 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e0368-6f56-43c3-bfd8-882a3fa9c92e None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:47.415410 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e0368-6f56-43c3-bfd8-882a3fa9c92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:47.435712 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-1c2e0368-6f56-43c3-bfd8-882a3fa9c92e None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:20:47.436980 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-1c2e0368-6f56-43c3-bfd8-882a3fa9c92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:20:47.445429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 461/948] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:20:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:20:47.789922 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3f6c7-cf45-4f3d-9bed-c1aa36888086 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:20:47.800488 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3f6c7-cf45-4f3d-9bed-c1aa36888086 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:20:47.804003 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f90656-ea98-48ee-b007-160f729951a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:20:47.805240 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f90656-ea98-48ee-b007-160f729951a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:47.805674 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f90656-ea98-48ee-b007-160f729951a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:47.805952 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f90656-ea98-48ee-b007-160f729951a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:47.816584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f90656-ea98-48ee-b007-160f729951a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:20:47.818117 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f90656-ea98-48ee-b007-160f729951a6 service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:20:47.829421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 488/949] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:20:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:20:50.082944 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195f3d3-685d-4568-9f66-93cfeeca73b9 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:50.083450 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195f3d3-685d-4568-9f66-93cfeeca73b9 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:50.083450 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195f3d3-685d-4568-9f66-93cfeeca73b9 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:50.084766 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 462/950] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:20:50.090476 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b386acc-23fb-4737-9e03-a706e599fd21 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:50.090900 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b386acc-23fb-4737-9e03-a706e599fd21 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:50.091024 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b386acc-23fb-4737-9e03-a706e599fd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:50.110756 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-4b386acc-23fb-4737-9e03-a706e599fd21 None None] MFA Rules not processed for user `6d0e2c6f0e0343118653a302efb265d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:20:50.111965 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-4b386acc-23fb-4737-9e03-a706e599fd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:20:50.119672 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 489/951] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:20:50 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:20:50.465535 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195f3d3-685d-4568-9f66-93cfeeca73b9 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:20:50.476205 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195f3d3-685d-4568-9f66-93cfeeca73b9 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:20:50.479808 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f63a1d-6bcf-4d0d-aa75-1df2c01b7b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:20:50.480405 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f63a1d-6bcf-4d0d-aa75-1df2c01b7b55 service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:50.480682 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f63a1d-6bcf-4d0d-aa75-1df2c01b7b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:50.480984 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f63a1d-6bcf-4d0d-aa75-1df2c01b7b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:50.490271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f63a1d-6bcf-4d0d-aa75-1df2c01b7b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:20:50.491917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f63a1d-6bcf-4d0d-aa75-1df2c01b7b55 service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:20:50.501533 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 463/952] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:20:50 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:20:53.140089 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e766d-a990-4b88-82ab-c96debf2ea72 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:53.140725 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e766d-a990-4b88-82ab-c96debf2ea72 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:53.140725 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e766d-a990-4b88-82ab-c96debf2ea72 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:53.142170 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 490/953] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:20:53.148791 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac047d-d5db-49e0-b5d4-ae4940bf6d7e None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:53.149346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac047d-d5db-49e0-b5d4-ae4940bf6d7e None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:53.149346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac047d-d5db-49e0-b5d4-ae4940bf6d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:53.168110 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-53ac047d-d5db-49e0-b5d4-ae4940bf6d7e None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:20:53.169311 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-53ac047d-d5db-49e0-b5d4-ae4940bf6d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:20:53.176930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 464/954] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:20:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:20:53.513407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e766d-a990-4b88-82ab-c96debf2ea72 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:20:53.525684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e766d-a990-4b88-82ab-c96debf2ea72 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:20:53.529584 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5dcef-53c0-4b63-bb88-d3a0b9682edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:20:53.530215 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5dcef-53c0-4b63-bb88-d3a0b9682edf service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:53.530496 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5dcef-53c0-4b63-bb88-d3a0b9682edf service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:53.530768 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5dcef-53c0-4b63-bb88-d3a0b9682edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:53.540954 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5dcef-53c0-4b63-bb88-d3a0b9682edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:20:53.542413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5dcef-53c0-4b63-bb88-d3a0b9682edf service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:20:53.552498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 491/955] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:20:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:20:55.809795 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205910d-2083-43b5-a1c4-a01747c1e81c None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:55.810306 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205910d-2083-43b5-a1c4-a01747c1e81c None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:55.810306 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205910d-2083-43b5-a1c4-a01747c1e81c None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:55.811623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 465/956] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:20:55.817698 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f4b2d-3b0a-46f9-ad8e-8ef4e742444b None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:55.818131 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f4b2d-3b0a-46f9-ad8e-8ef4e742444b None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:55.818282 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f4b2d-3b0a-46f9-ad8e-8ef4e742444b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:55.826622 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:20:55.839889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-8b0f4b2d-3b0a-46f9-ad8e-8ef4e742444b None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:20:55.841239 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-8b0f4b2d-3b0a-46f9-ad8e-8ef4e742444b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:20:55.849426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 492/957] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:20:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:20:56.193636 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205910d-2083-43b5-a1c4-a01747c1e81c None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:20:56.200110 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=65 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:20:56.205968 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205910d-2083-43b5-a1c4-a01747c1e81c None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:20:56.209419 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b103eb-93ab-41a6-9531-5ed16c12079e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:20:56.210648 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b103eb-93ab-41a6-9531-5ed16c12079e service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:56.211098 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b103eb-93ab-41a6-9531-5ed16c12079e service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:56.211373 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b103eb-93ab-41a6-9531-5ed16c12079e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:56.220381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b103eb-93ab-41a6-9531-5ed16c12079e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:20:56.221952 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b103eb-93ab-41a6-9531-5ed16c12079e service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:20:56.232367 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 466/958] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:20:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:20:59.089956 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a79e9b-51be-4cb6-8b7a-1854b3a996c2 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:59.090514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a79e9b-51be-4cb6-8b7a-1854b3a996c2 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:59.090514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a79e9b-51be-4cb6-8b7a-1854b3a996c2 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:59.091834 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 493/959] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:20:59.097003 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9550dd-0deb-44ed-a3d5-baa78c04810e None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:59.097405 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9550dd-0deb-44ed-a3d5-baa78c04810e None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:59.097547 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9550dd-0deb-44ed-a3d5-baa78c04810e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:59.117140 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-6f9550dd-0deb-44ed-a3d5-baa78c04810e None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:20:59.118329 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-6f9550dd-0deb-44ed-a3d5-baa78c04810e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:20:59.125845 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 467/960] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:20:59 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:20:59.467703 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a79e9b-51be-4cb6-8b7a-1854b3a996c2 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:20:59.478668 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a79e9b-51be-4cb6-8b7a-1854b3a996c2 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:20:59.482120 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738c59b-0131-4ab1-b8ab-2286fe2721a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:20:59.485334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738c59b-0131-4ab1-b8ab-2286fe2721a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:20:59.485334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738c59b-0131-4ab1-b8ab-2286fe2721a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:20:59.485334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738c59b-0131-4ab1-b8ab-2286fe2721a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:20:59.492614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738c59b-0131-4ab1-b8ab-2286fe2721a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:20:59.494057 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738c59b-0131-4ab1-b8ab-2286fe2721a8 service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:20:59.503142 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 494/961] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:20:59 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:21:03.994649 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83137de6-855b-469a-b060-e61afc394475 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:03.995182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83137de6-855b-469a-b060-e61afc394475 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:03.995182 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83137de6-855b-469a-b060-e61afc394475 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:03.996727 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 468/962] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:21:04.001911 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e694aef-81b5-4718-b605-20b566eec090 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:04.002364 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e694aef-81b5-4718-b605-20b566eec090 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:04.002463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e694aef-81b5-4718-b605-20b566eec090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:04.024822 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-1e694aef-81b5-4718-b605-20b566eec090 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:04.026091 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-1e694aef-81b5-4718-b605-20b566eec090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:04.034000 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 495/963] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:21:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:21:04.397407 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83137de6-855b-469a-b060-e61afc394475 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:21:04.408060 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83137de6-855b-469a-b060-e61afc394475 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:21:04.411534 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aff14d-240b-4175-a7e5-5331292323d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:21:04.412121 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aff14d-240b-4175-a7e5-5331292323d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:04.412399 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aff14d-240b-4175-a7e5-5331292323d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:04.413185 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aff14d-240b-4175-a7e5-5331292323d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:04.422099 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aff14d-240b-4175-a7e5-5331292323d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:21:04.423536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aff14d-240b-4175-a7e5-5331292323d9 service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:21:04.433569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 469/964] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:21:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:21:07.622725 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463c5bf-1d83-4a25-9a54-ef072a7a9640 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:07.623240 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463c5bf-1d83-4a25-9a54-ef072a7a9640 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:07.623240 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463c5bf-1d83-4a25-9a54-ef072a7a9640 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:07.624740 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 496/965] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:07.629678 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426772-338f-4bce-8007-4d3a81cfb153 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:07.630118 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426772-338f-4bce-8007-4d3a81cfb153 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:07.630227 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a426772-338f-4bce-8007-4d3a81cfb153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:07.649311 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-0a426772-338f-4bce-8007-4d3a81cfb153 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:07.650491 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-0a426772-338f-4bce-8007-4d3a81cfb153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:07.658347 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 470/966] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:21:07 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:21:08.006249 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463c5bf-1d83-4a25-9a54-ef072a7a9640 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:21:08.018072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463c5bf-1d83-4a25-9a54-ef072a7a9640 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:21:08.021520 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c558d7-ec19-4619-9963-2a22abfe2ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:21:08.022399 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c558d7-ec19-4619-9963-2a22abfe2ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:08.022677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c558d7-ec19-4619-9963-2a22abfe2ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:08.022949 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c558d7-ec19-4619-9963-2a22abfe2ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:08.031976 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c558d7-ec19-4619-9963-2a22abfe2ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:21:08.033459 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c558d7-ec19-4619-9963-2a22abfe2ee0 service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:21:08.043398 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 497/967] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:21:08 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:21:12.542839 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a50d6-a7e0-47dd-a9ec-ac3c681418df None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:12.543370 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a50d6-a7e0-47dd-a9ec-ac3c681418df None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:12.543370 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a50d6-a7e0-47dd-a9ec-ac3c681418df None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:12.544728 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 471/968] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:12.550226 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b8c19-a568-44cf-a958-c53dcf53831d None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:12.550998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b8c19-a568-44cf-a958-c53dcf53831d None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:12.551422 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b8c19-a568-44cf-a958-c53dcf53831d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:12.573764 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-649b8c19-a568-44cf-a958-c53dcf53831d None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:12.575313 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-649b8c19-a568-44cf-a958-c53dcf53831d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:12.585658 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 498/969] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:21:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:21:12.937726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a50d6-a7e0-47dd-a9ec-ac3c681418df None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:21:12.948822 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a50d6-a7e0-47dd-a9ec-ac3c681418df None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:21:12.952380 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d584f-245a-43fc-b9b9-97774c418836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:21:12.952998 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d584f-245a-43fc-b9b9-97774c418836 service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:12.953278 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d584f-245a-43fc-b9b9-97774c418836 service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:12.953547 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d584f-245a-43fc-b9b9-97774c418836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:12.962493 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d584f-245a-43fc-b9b9-97774c418836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:21:12.963929 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d584f-245a-43fc-b9b9-97774c418836 service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:21:12.973575 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 472/970] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:21:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:21:18.486568 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad0dfa-22ab-4bbf-80aa-6f5fd6d00a8c None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:18.487495 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad0dfa-22ab-4bbf-80aa-6f5fd6d00a8c None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:18.487939 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad0dfa-22ab-4bbf-80aa-6f5fd6d00a8c None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:18.490355 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 499/971] 10.222.0.82 () {54 vars in 921 bytes} [Fri Aug 19 01:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:18.495571 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59397444-85c9-48d6-bd59-704e1ce2859d None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:18.496403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59397444-85c9-48d6-bd59-704e1ce2859d None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:18.496889 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59397444-85c9-48d6-bd59-704e1ce2859d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:18.555773 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-59397444-85c9-48d6-bd59-704e1ce2859d None None] MFA Rules not processed for user `246b63ecc51347f08daad24d75e3de27`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:18.557341 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-59397444-85c9-48d6-bd59-704e1ce2859d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:18.647835 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 473/972] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Aug 19 01:21:18 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:21:22.566860 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=20 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:21:23.386239 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e9af2-ec66-4db1-89c3-58d1f57544c2 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:23.386652 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e9af2-ec66-4db1-89c3-58d1f57544c2 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:23.386783 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e9af2-ec66-4db1-89c3-58d1f57544c2 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:23.388272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 500/973] 10.222.0.82 () {54 vars in 921 bytes} [Fri Aug 19 01:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:23.393473 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522b360-e96f-4737-852a-205edb856db4 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:23.393940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522b360-e96f-4737-852a-205edb856db4 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:23.394053 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522b360-e96f-4737-852a-205edb856db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:23.415348 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-2522b360-e96f-4737-852a-205edb856db4 None None] MFA Rules not processed for user `246b63ecc51347f08daad24d75e3de27`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:23.416553 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-2522b360-e96f-4737-852a-205edb856db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:23.428914 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 474/974] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Aug 19 01:21:23 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:21:24.854002 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e72ad-b07b-4411-b876-6fd819cc9e80 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:24.854503 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e72ad-b07b-4411-b876-6fd819cc9e80 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:24.854615 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e72ad-b07b-4411-b876-6fd819cc9e80 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:24.856006 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 501/975] 10.222.0.82 () {54 vars in 921 bytes} [Fri Aug 19 01:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:24.861038 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be6cb-56d2-4dbf-b414-c768fc2f1f45 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:24.865156 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be6cb-56d2-4dbf-b414-c768fc2f1f45 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:24.865156 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be6cb-56d2-4dbf-b414-c768fc2f1f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:24.882071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-9b4be6cb-56d2-4dbf-b414-c768fc2f1f45 None None] MFA Rules not processed for user `246b63ecc51347f08daad24d75e3de27`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:24.883259 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-9b4be6cb-56d2-4dbf-b414-c768fc2f1f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:24.892744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 475/976] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Aug 19 01:21:24 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:21:28.686409 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3146ae-42f1-42ff-b6d7-ce6c804057bc None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:28.686851 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3146ae-42f1-42ff-b6d7-ce6c804057bc None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:28.686950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3146ae-42f1-42ff-b6d7-ce6c804057bc None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:28.693957 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 502/977] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:21:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:28.695022 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c4d6e-0231-4998-9a7e-213a8f519cb1 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:28.695478 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c4d6e-0231-4998-9a7e-213a8f519cb1 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:28.695559 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c4d6e-0231-4998-9a7e-213a8f519cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:28.704017 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=69 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:21:28.718528 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-7f0c4d6e-0231-4998-9a7e-213a8f519cb1 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:28.720168 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-7f0c4d6e-0231-4998-9a7e-213a8f519cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:28.730040 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 476/978] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:21:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:21:29.103259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f302be-7042-4103-96f8-ebc108f342c9 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:29.103259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f302be-7042-4103-96f8-ebc108f342c9 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:29.103259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f302be-7042-4103-96f8-ebc108f342c9 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:29.103596 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 503/979] 10.222.0.82 () {54 vars in 962 bytes} [Fri Aug 19 01:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:29.111737 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b48c89-6377-4f1f-b9d1-c6778beea979 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:29.112227 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b48c89-6377-4f1f-b9d1-c6778beea979 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:29.112582 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b48c89-6377-4f1f-b9d1-c6778beea979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:29.168464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-19b48c89-6377-4f1f-b9d1-c6778beea979 None None] MFA Rules not processed for user `ea9fe590dcf441b09f4fe18bf3d8a7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:29.169859 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-19b48c89-6377-4f1f-b9d1-c6778beea979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:29.246221 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 477/980] 10.222.0.82 () {58 vars in 1059 bytes} [Fri Aug 19 01:21:29 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:21:29.255516 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f302be-7042-4103-96f8-ebc108f342c9 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:21:29.272296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f302be-7042-4103-96f8-ebc108f342c9 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:21:29.278180 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83661d-90c5-47f0-94af-03aa416a75b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:21:29.278778 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83661d-90c5-47f0-94af-03aa416a75b7 service nova] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:29.279148 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83661d-90c5-47f0-94af-03aa416a75b7 service nova] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:29.279510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83661d-90c5-47f0-94af-03aa416a75b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:29.290668 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83661d-90c5-47f0-94af-03aa416a75b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:21:29.292392 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83661d-90c5-47f0-94af-03aa416a75b7 service nova] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:21:29.303321 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 504/981] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:21:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 01:21:31.765051 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6fffb-8efe-4054-888c-f2f9f6f7c76c None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:31.765586 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6fffb-8efe-4054-888c-f2f9f6f7c76c None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:31.765586 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6fffb-8efe-4054-888c-f2f9f6f7c76c None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:31.769236 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 478/982] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:21:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:31.772675 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b164b-0ea5-4ca4-a52c-48f21339fb3d None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:31.773218 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b164b-0ea5-4ca4-a52c-48f21339fb3d None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:31.773520 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b164b-0ea5-4ca4-a52c-48f21339fb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:31.795209 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-b39b164b-0ea5-4ca4-a52c-48f21339fb3d None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:31.796638 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-b39b164b-0ea5-4ca4-a52c-48f21339fb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:31.813935 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 505/983] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:21:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:21:32.165084 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6fffb-8efe-4054-888c-f2f9f6f7c76c None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:21:32.179434 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6fffb-8efe-4054-888c-f2f9f6f7c76c None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:21:32.184250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1f5b9-44c2-4945-a272-946cac6e2a22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:21:32.184834 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1f5b9-44c2-4945-a272-946cac6e2a22 service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:32.185170 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1f5b9-44c2-4945-a272-946cac6e2a22 service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:32.185432 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1f5b9-44c2-4945-a272-946cac6e2a22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:32.195591 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1f5b9-44c2-4945-a272-946cac6e2a22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:21:32.197212 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1f5b9-44c2-4945-a272-946cac6e2a22 service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:21:32.207234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 479/984] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:21:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:21:34.948879 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b05d4b-49b7-4019-8316-2e4861133f48 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:34.949431 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b05d4b-49b7-4019-8316-2e4861133f48 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:34.949431 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b05d4b-49b7-4019-8316-2e4861133f48 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:34.950771 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 506/985] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:34.956218 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4629154-4d8e-4c2a-9d4f-fe04f3554b60 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:34.956720 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4629154-4d8e-4c2a-9d4f-fe04f3554b60 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:34.956907 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4629154-4d8e-4c2a-9d4f-fe04f3554b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:34.978660 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-c4629154-4d8e-4c2a-9d4f-fe04f3554b60 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:34.980021 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-c4629154-4d8e-4c2a-9d4f-fe04f3554b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:34.993107 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 480/986] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:21:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:21:35.412135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be42306-9382-4201-8b75-8c881c833187 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:35.412418 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be42306-9382-4201-8b75-8c881c833187 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:35.412965 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be42306-9382-4201-8b75-8c881c833187 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:35.414603 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 507/987] 10.222.0.82 () {54 vars in 962 bytes} [Fri Aug 19 01:21:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:35.421712 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fb540-7b69-456a-ba17-62a606f010a9 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:35.421994 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fb540-7b69-456a-ba17-62a606f010a9 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:35.422458 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fb540-7b69-456a-ba17-62a606f010a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:35.450715 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-e91fb540-7b69-456a-ba17-62a606f010a9 None None] MFA Rules not processed for user `ea9fe590dcf441b09f4fe18bf3d8a7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:35.452507 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-e91fb540-7b69-456a-ba17-62a606f010a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:35.464950 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 481/988] 10.222.0.82 () {58 vars in 1059 bytes} [Fri Aug 19 01:21:35 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:21:35.475420 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be42306-9382-4201-8b75-8c881c833187 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:21:35.499479 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be42306-9382-4201-8b75-8c881c833187 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:21:35.505967 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67a463-b2b4-4d8a-a84c-ba968d8c13b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:21:35.506888 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67a463-b2b4-4d8a-a84c-ba968d8c13b0 service nova] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:35.507374 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67a463-b2b4-4d8a-a84c-ba968d8c13b0 service nova] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:35.509418 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67a463-b2b4-4d8a-a84c-ba968d8c13b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:35.518634 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67a463-b2b4-4d8a-a84c-ba968d8c13b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:21:35.522907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67a463-b2b4-4d8a-a84c-ba968d8c13b0 service nova] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:21:35.534482 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 508/989] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:21:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:21:38.360677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae2e95-2725-4f0e-bf4b-07de8d829d96 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:38.361231 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae2e95-2725-4f0e-bf4b-07de8d829d96 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:38.361542 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae2e95-2725-4f0e-bf4b-07de8d829d96 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:38.367394 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 482/990] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:21:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:38.368749 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412fc7e-eda4-4603-ad61-2e45723580cb None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:38.369212 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412fc7e-eda4-4603-ad61-2e45723580cb None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:38.369439 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412fc7e-eda4-4603-ad61-2e45723580cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:38.390100 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-4412fc7e-eda4-4603-ad61-2e45723580cb None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:38.391672 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-4412fc7e-eda4-4603-ad61-2e45723580cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:38.401640 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 509/991] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:21:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:21:38.779379 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae2e95-2725-4f0e-bf4b-07de8d829d96 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:21:38.794153 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae2e95-2725-4f0e-bf4b-07de8d829d96 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:21:38.799821 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf14ab-e3f9-4be0-a2fd-3a204128e56b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:21:38.803160 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf14ab-e3f9-4be0-a2fd-3a204128e56b service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:38.803160 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf14ab-e3f9-4be0-a2fd-3a204128e56b service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:38.803160 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf14ab-e3f9-4be0-a2fd-3a204128e56b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:38.813944 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf14ab-e3f9-4be0-a2fd-3a204128e56b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:21:38.815606 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf14ab-e3f9-4be0-a2fd-3a204128e56b service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:21:38.838816 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 483/992] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:21:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:21:39.234362 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f73f7-2271-4b44-a9c3-b3782e7fbea9 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:39.234656 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f73f7-2271-4b44-a9c3-b3782e7fbea9 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:39.234929 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f73f7-2271-4b44-a9c3-b3782e7fbea9 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:39.236463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 510/993] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:39.242532 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5068057-dca1-484d-b7ea-a0b4a299a99e None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:39.243161 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5068057-dca1-484d-b7ea-a0b4a299a99e None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:39.243667 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5068057-dca1-484d-b7ea-a0b4a299a99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:39.306737 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-a5068057-dca1-484d-b7ea-a0b4a299a99e None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:39.308415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-a5068057-dca1-484d-b7ea-a0b4a299a99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:39.317930 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 484/994] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:21:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:21:39.929205 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e0221-facd-46ad-a761-dbcda76cadcd None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:39.929205 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e0221-facd-46ad-a761-dbcda76cadcd None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:39.929205 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e0221-facd-46ad-a761-dbcda76cadcd None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:39.931665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 511/995] 10.222.0.82 () {54 vars in 964 bytes} [Fri Aug 19 01:21:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:39.935598 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1d09e-6dd7-45cd-bb2c-6dc9410a455c None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:39.936071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1d09e-6dd7-45cd-bb2c-6dc9410a455c None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:39.936225 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1d09e-6dd7-45cd-bb2c-6dc9410a455c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:39.988136 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-e7c1d09e-6dd7-45cd-bb2c-6dc9410a455c None None] MFA Rules not processed for user `1d273bdfc2d147ba9392544f9e8831a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:39.990302 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-e7c1d09e-6dd7-45cd-bb2c-6dc9410a455c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:40.041597 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=100 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:21:40.058428 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 485/996] 10.222.0.82 () {58 vars in 1061 bytes} [Fri Aug 19 01:21:39 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:21:40.065773 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e0221-facd-46ad-a761-dbcda76cadcd None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:21:40.077135 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e0221-facd-46ad-a761-dbcda76cadcd None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:21:40.080569 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c898c6-0bfd-4f2d-a9e7-e58fbfcaa77a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d273bdfc2d147ba9392544f9e8831a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:21:40.081202 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c898c6-0bfd-4f2d-a9e7-e58fbfcaa77a service cinder] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:40.081480 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c898c6-0bfd-4f2d-a9e7-e58fbfcaa77a service cinder] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:40.081748 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c898c6-0bfd-4f2d-a9e7-e58fbfcaa77a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:40.090947 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c898c6-0bfd-4f2d-a9e7-e58fbfcaa77a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:21:40.092370 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c898c6-0bfd-4f2d-a9e7-e58fbfcaa77a service cinder] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:21:40.105031 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 512/997] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:21:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 01:21:41.304668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd5311-6838-4bec-b54e-42160b50b109 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:41.305226 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd5311-6838-4bec-b54e-42160b50b109 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:41.305226 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd5311-6838-4bec-b54e-42160b50b109 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:41.306775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 486/998] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:41.312231 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513299b8-102d-4003-891b-a04cd579b30f None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:41.313058 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513299b8-102d-4003-891b-a04cd579b30f None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:41.313493 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513299b8-102d-4003-891b-a04cd579b30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:41.336912 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-513299b8-102d-4003-891b-a04cd579b30f None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:41.338081 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-513299b8-102d-4003-891b-a04cd579b30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:41.353226 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 513/999] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:21:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:21:41.696751 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd5311-6838-4bec-b54e-42160b50b109 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:21:41.710295 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd5311-6838-4bec-b54e-42160b50b109 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:21:41.715235 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8dd89c-6215-43c1-82f6-886c771b7033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:21:41.715826 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dd89c-6215-43c1-82f6-886c771b7033 service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:41.716107 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dd89c-6215-43c1-82f6-886c771b7033 service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:41.716380 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8dd89c-6215-43c1-82f6-886c771b7033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:41.725104 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8dd89c-6215-43c1-82f6-886c771b7033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:21:41.726801 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8dd89c-6215-43c1-82f6-886c771b7033 service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:21:41.736396 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 487/1000] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:21:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:21:44.111316 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5d7e-4652-44a0-973b-8a332208d540 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:44.112313 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5d7e-4652-44a0-973b-8a332208d540 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:44.112900 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5d7e-4652-44a0-973b-8a332208d540 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:44.118481 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 514/1001] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:21:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:44.121486 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02a00e-5469-4966-805d-4ab5540b99ce None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:44.122312 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02a00e-5469-4966-805d-4ab5540b99ce None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:44.122730 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02a00e-5469-4966-805d-4ab5540b99ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:44.150641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-7b02a00e-5469-4966-805d-4ab5540b99ce None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:44.153598 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-7b02a00e-5469-4966-805d-4ab5540b99ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:44.168491 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 488/1002] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:21:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:21:44.516929 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d5d7e-4652-44a0-973b-8a332208d540 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:21:44.531504 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d5d7e-4652-44a0-973b-8a332208d540 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:21:44.537014 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b461e-9589-4130-b0e8-c2eb02bc0aad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:21:44.537846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b461e-9589-4130-b0e8-c2eb02bc0aad service nova] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:44.538264 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b461e-9589-4130-b0e8-c2eb02bc0aad service nova] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:44.538686 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b461e-9589-4130-b0e8-c2eb02bc0aad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:44.549457 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b461e-9589-4130-b0e8-c2eb02bc0aad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:21:44.552319 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b461e-9589-4130-b0e8-c2eb02bc0aad service nova] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:21:44.563284 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 515/1003] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:21:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:21:46.943333 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91035b26-f11b-48de-9873-d893d4d79a40 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:46.943910 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91035b26-f11b-48de-9873-d893d4d79a40 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:46.943910 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91035b26-f11b-48de-9873-d893d4d79a40 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:46.945408 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 489/1004] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:21:46.950435 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31633d0-682e-4e45-9ecc-2edd5f8cc760 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:46.950853 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31633d0-682e-4e45-9ecc-2edd5f8cc760 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:46.950990 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31633d0-682e-4e45-9ecc-2edd5f8cc760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:46.970171 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-c31633d0-682e-4e45-9ecc-2edd5f8cc760 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:46.971359 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-c31633d0-682e-4e45-9ecc-2edd5f8cc760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:46.979331 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 516/1005] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:21:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:21:47.330349 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91035b26-f11b-48de-9873-d893d4d79a40 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:21:47.349420 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91035b26-f11b-48de-9873-d893d4d79a40 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:21:47.355391 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f360fc-a9eb-4ed0-b4cf-061430dca71a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:21:47.355996 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f360fc-a9eb-4ed0-b4cf-061430dca71a service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:47.356274 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f360fc-a9eb-4ed0-b4cf-061430dca71a service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:47.356547 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f360fc-a9eb-4ed0-b4cf-061430dca71a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:47.366013 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f360fc-a9eb-4ed0-b4cf-061430dca71a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:21:47.367613 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f360fc-a9eb-4ed0-b4cf-061430dca71a service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:21:47.377899 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 490/1006] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:21:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:21:49.621944 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37124c-07b9-4840-b379-1493567e4136 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:49.622645 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37124c-07b9-4840-b379-1493567e4136 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:49.622645 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37124c-07b9-4840-b379-1493567e4136 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:49.623907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 517/1007] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:49.630227 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320af992-8f2b-4f6d-9eda-9d1c2ecf12a2 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:49.630697 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320af992-8f2b-4f6d-9eda-9d1c2ecf12a2 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:49.630803 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320af992-8f2b-4f6d-9eda-9d1c2ecf12a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:49.651739 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-320af992-8f2b-4f6d-9eda-9d1c2ecf12a2 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:49.653095 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-320af992-8f2b-4f6d-9eda-9d1c2ecf12a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:49.662325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 491/1008] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:21:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:21:50.096724 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37124c-07b9-4840-b379-1493567e4136 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:21:50.096724 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37124c-07b9-4840-b379-1493567e4136 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:21:50.096724 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b9ca5-3c3b-4685-96da-9e9470ea49e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:21:50.096724 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9ca5-3c3b-4685-96da-9e9470ea49e7 service nova] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:50.097226 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9ca5-3c3b-4685-96da-9e9470ea49e7 service nova] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:50.097226 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9ca5-3c3b-4685-96da-9e9470ea49e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:50.097226 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b9ca5-3c3b-4685-96da-9e9470ea49e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:21:50.097226 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b9ca5-3c3b-4685-96da-9e9470ea49e7 service nova] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:21:50.105758 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 518/1009] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:21:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:21:53.032401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad9f52-610a-44d2-ad0b-77b5e6df3d3c None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:53.033278 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad9f52-610a-44d2-ad0b-77b5e6df3d3c None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:53.033278 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad9f52-610a-44d2-ad0b-77b5e6df3d3c None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:53.034392 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 492/1010] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:53.040289 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db662549-f038-4a70-968b-a5d3defbb952 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:53.040951 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db662549-f038-4a70-968b-a5d3defbb952 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:53.040951 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db662549-f038-4a70-968b-a5d3defbb952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:53.048205 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=43 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:21:53.061894 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-db662549-f038-4a70-968b-a5d3defbb952 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:53.064207 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-db662549-f038-4a70-968b-a5d3defbb952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:53.073045 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 519/1011] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:21:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:21:53.739544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad9f52-610a-44d2-ad0b-77b5e6df3d3c None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:21:53.754737 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad9f52-610a-44d2-ad0b-77b5e6df3d3c None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:21:53.760273 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52b3e5-b2e0-49d6-9193-9f418b62e959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:21:53.760926 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52b3e5-b2e0-49d6-9193-9f418b62e959 service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:53.761235 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52b3e5-b2e0-49d6-9193-9f418b62e959 service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:53.761549 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52b3e5-b2e0-49d6-9193-9f418b62e959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:53.771793 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52b3e5-b2e0-49d6-9193-9f418b62e959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:21:53.773628 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52b3e5-b2e0-49d6-9193-9f418b62e959 service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:21:53.784085 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 493/1012] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:21:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:21:56.518663 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cdb28-0ca5-47da-90c7-34c37f0869a5 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:56.519312 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cdb28-0ca5-47da-90c7-34c37f0869a5 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:56.519312 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cdb28-0ca5-47da-90c7-34c37f0869a5 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:56.520690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 520/1013] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:56.526101 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be187cd4-3de2-462c-b137-c6caa836e58d None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:56.526586 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be187cd4-3de2-462c-b137-c6caa836e58d None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:56.526690 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be187cd4-3de2-462c-b137-c6caa836e58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:56.548385 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-be187cd4-3de2-462c-b137-c6caa836e58d None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:56.549640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-be187cd4-3de2-462c-b137-c6caa836e58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:56.558844 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 494/1014] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:21:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:21:56.752678 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b0d98-2b1a-4120-96d4-17b9c19c42f4 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:56.753084 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b0d98-2b1a-4120-96d4-17b9c19c42f4 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:56.753283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b0d98-2b1a-4120-96d4-17b9c19c42f4 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:56.755183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 521/1015] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:56.759816 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecc32a-02b2-4265-977d-05684d64894d None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:56.760132 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecc32a-02b2-4265-977d-05684d64894d None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:56.760408 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecc32a-02b2-4265-977d-05684d64894d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:56.780778 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-ceecc32a-02b2-4265-977d-05684d64894d None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:56.781926 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-ceecc32a-02b2-4265-977d-05684d64894d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:56.790457 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 495/1016] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:21:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:21:56.908813 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b0d98-2b1a-4120-96d4-17b9c19c42f4 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:21:56.921948 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b0d98-2b1a-4120-96d4-17b9c19c42f4 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:21:56.926724 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32079910-0aee-4b77-8089-9d85b072ec41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:21:56.927403 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079910-0aee-4b77-8089-9d85b072ec41 service nova] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:56.927680 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079910-0aee-4b77-8089-9d85b072ec41 service nova] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:56.927961 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079910-0aee-4b77-8089-9d85b072ec41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:56.935877 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32079910-0aee-4b77-8089-9d85b072ec41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:21:56.937476 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32079910-0aee-4b77-8089-9d85b072ec41 service nova] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:21:56.947138 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 522/1017] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:21:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:21:57.152352 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf1acb-fe1a-4503-9e8f-7c1a89fa0095 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:57.152636 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf1acb-fe1a-4503-9e8f-7c1a89fa0095 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:57.152959 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf1acb-fe1a-4503-9e8f-7c1a89fa0095 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:57.154339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 496/1018] 10.222.0.82 () {54 vars in 967 bytes} [Fri Aug 19 01:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:57.160114 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03dd9f-1704-410b-9b1a-ec81a59f3868 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:57.160426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03dd9f-1704-410b-9b1a-ec81a59f3868 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:57.160705 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03dd9f-1704-410b-9b1a-ec81a59f3868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:57.217029 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-4b03dd9f-1704-410b-9b1a-ec81a59f3868 None None] MFA Rules not processed for user `0cd2faa457434dc6bfec69ecfa952ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:57.218272 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-4b03dd9f-1704-410b-9b1a-ec81a59f3868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:57.284184 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 523/1019] 10.222.0.82 () {58 vars in 1064 bytes} [Fri Aug 19 01:21:57 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:21:57.293010 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf1acb-fe1a-4503-9e8f-7c1a89fa0095 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:21:57.303900 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf1acb-fe1a-4503-9e8f-7c1a89fa0095 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:21:57.307533 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab006a0a-1c5c-46e9-a9b6-3bc40a4a10d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd2faa457434dc6bfec69ecfa952ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:21:57.308145 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab006a0a-1c5c-46e9-a9b6-3bc40a4a10d7 service glance] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:57.308426 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab006a0a-1c5c-46e9-a9b6-3bc40a4a10d7 service glance] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:57.308698 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab006a0a-1c5c-46e9-a9b6-3bc40a4a10d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:57.322774 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab006a0a-1c5c-46e9-a9b6-3bc40a4a10d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:21:57.324226 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab006a0a-1c5c-46e9-a9b6-3bc40a4a10d7 service glance] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:21:57.334232 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 497/1020] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:21:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:21:59.349346 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affca94-c5e6-450b-a9e7-8cb5a4599e18 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:59.349941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affca94-c5e6-450b-a9e7-8cb5a4599e18 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:59.349941 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affca94-c5e6-450b-a9e7-8cb5a4599e18 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:59.351419 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 524/1021] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:21:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:21:59.356909 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03938-98b7-4ad6-8695-a8dc09ae9018 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:59.357419 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03938-98b7-4ad6-8695-a8dc09ae9018 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:59.361451 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03938-98b7-4ad6-8695-a8dc09ae9018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:59.382803 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-d3a03938-98b7-4ad6-8695-a8dc09ae9018 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:21:59.384020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-d3a03938-98b7-4ad6-8695-a8dc09ae9018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:21:59.392604 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 498/1022] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:21:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:21:59.757337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affca94-c5e6-450b-a9e7-8cb5a4599e18 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:21:59.773400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affca94-c5e6-450b-a9e7-8cb5a4599e18 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:21:59.780984 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a6348-ef9f-4b9d-82b3-6ad6cdc53a9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:21:59.781599 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6348-ef9f-4b9d-82b3-6ad6cdc53a9d service nova] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:21:59.781874 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6348-ef9f-4b9d-82b3-6ad6cdc53a9d service nova] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:21:59.782142 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6348-ef9f-4b9d-82b3-6ad6cdc53a9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:21:59.791366 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a6348-ef9f-4b9d-82b3-6ad6cdc53a9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:21:59.793364 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a6348-ef9f-4b9d-82b3-6ad6cdc53a9d service nova] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:21:59.802838 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 525/1023] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:21:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:02.293566 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd068d-8aee-4291-a643-a0d67eae4725 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:02.294131 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd068d-8aee-4291-a643-a0d67eae4725 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:02.294131 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd068d-8aee-4291-a643-a0d67eae4725 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:02.295357 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 499/1024] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:02.300951 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a0890-23a6-4d0c-be0a-3ad8285dfd9d None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:02.307220 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a0890-23a6-4d0c-be0a-3ad8285dfd9d None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:02.307220 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a0890-23a6-4d0c-be0a-3ad8285dfd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:02.321929 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-f73a0890-23a6-4d0c-be0a-3ad8285dfd9d None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:02.323163 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-f73a0890-23a6-4d0c-be0a-3ad8285dfd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:02.331121 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 526/1025] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:22:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:02.684311 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd068d-8aee-4291-a643-a0d67eae4725 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:02.697850 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd068d-8aee-4291-a643-a0d67eae4725 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:02.705673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a5373-cc76-4593-981c-770da39518d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:02.706344 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a5373-cc76-4593-981c-770da39518d3 service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:02.706628 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a5373-cc76-4593-981c-770da39518d3 service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:02.706897 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a5373-cc76-4593-981c-770da39518d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:02.717278 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a5373-cc76-4593-981c-770da39518d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:02.718867 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a5373-cc76-4593-981c-770da39518d3 service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:02.730275 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 500/1026] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:12.316696 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=55 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:22:12.725674 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=50 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:22:13.333998 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ca56c-a518-4be2-a4bd-53189ae70b62 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:13.334624 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ca56c-a518-4be2-a4bd-53189ae70b62 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:13.334624 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ca56c-a518-4be2-a4bd-53189ae70b62 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:13.335985 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 527/1027] 10.222.0.82 () {54 vars in 918 bytes} [Fri Aug 19 01:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:13.340992 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc92e8a-f44a-4918-8f65-e3fa031e54b7 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:13.341276 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc92e8a-f44a-4918-8f65-e3fa031e54b7 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:13.341543 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc92e8a-f44a-4918-8f65-e3fa031e54b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:13.361211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-6dc92e8a-f44a-4918-8f65-e3fa031e54b7 None None] MFA Rules not processed for user `246b63ecc51347f08daad24d75e3de27`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:13.362400 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-6dc92e8a-f44a-4918-8f65-e3fa031e54b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:13.371535 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 501/1028] 10.222.0.82 () {58 vars in 1015 bytes} [Fri Aug 19 01:22:13 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:22:13.385729 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37b217-6ef4-49bb-b0de-ec3280ecdaa3 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:13.386020 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37b217-6ef4-49bb-b0de-ec3280ecdaa3 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:13.386305 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37b217-6ef4-49bb-b0de-ec3280ecdaa3 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:13.387902 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 528/1029] 10.222.0.82 () {54 vars in 918 bytes} [Fri Aug 19 01:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:13.392696 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dabbf2-2d79-4d57-bb9f-dbb082a5ddff None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:13.393031 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dabbf2-2d79-4d57-bb9f-dbb082a5ddff None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:13.393307 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dabbf2-2d79-4d57-bb9f-dbb082a5ddff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:13.412725 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-d9dabbf2-2d79-4d57-bb9f-dbb082a5ddff None None] MFA Rules not processed for user `ea9fe590dcf441b09f4fe18bf3d8a7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:13.413945 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-d9dabbf2-2d79-4d57-bb9f-dbb082a5ddff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:13.422412 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 502/1030] 10.222.0.82 () {58 vars in 1015 bytes} [Fri Aug 19 01:22:13 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:16.103943 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765270f-bb38-4315-aea7-92c5297e0ece None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:16.104541 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765270f-bb38-4315-aea7-92c5297e0ece None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:16.104541 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765270f-bb38-4315-aea7-92c5297e0ece None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:16.105864 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 529/1031] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:16.111193 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a2f06-fb5d-4304-ab5e-83ea09b7989e None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:16.111641 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a2f06-fb5d-4304-ab5e-83ea09b7989e None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:16.111759 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a2f06-fb5d-4304-ab5e-83ea09b7989e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:16.130929 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-8e8a2f06-fb5d-4304-ab5e-83ea09b7989e None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:16.132168 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-8e8a2f06-fb5d-4304-ab5e-83ea09b7989e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:16.140057 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 503/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:22:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:16.484338 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765270f-bb38-4315-aea7-92c5297e0ece None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:16.498573 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765270f-bb38-4315-aea7-92c5297e0ece None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:16.503498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc385a-b013-4af8-a799-94c3eab89dd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:16.504088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc385a-b013-4af8-a799-94c3eab89dd1 service nova] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:16.504364 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc385a-b013-4af8-a799-94c3eab89dd1 service nova] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:16.504639 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc385a-b013-4af8-a799-94c3eab89dd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:16.512821 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc385a-b013-4af8-a799-94c3eab89dd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:16.514426 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc385a-b013-4af8-a799-94c3eab89dd1 service nova] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:16.523807 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 530/1033] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:17.480507 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dce47f-4a14-443c-93e5-eb232c7809d9 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:17.481130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dce47f-4a14-443c-93e5-eb232c7809d9 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:17.481130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dce47f-4a14-443c-93e5-eb232c7809d9 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:17.482401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 504/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 01:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:17.487188 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7afa4-a930-4450-aed7-75527cf49acc None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:17.488090 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7afa4-a930-4450-aed7-75527cf49acc None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:17.488285 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7afa4-a930-4450-aed7-75527cf49acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:17.508190 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-9fb7afa4-a930-4450-aed7-75527cf49acc None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:17.509391 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-9fb7afa4-a930-4450-aed7-75527cf49acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:17.517202 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 531/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 01:22:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:17.696759 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dce47f-4a14-443c-93e5-eb232c7809d9 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:17.710748 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dce47f-4a14-443c-93e5-eb232c7809d9 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:17.715605 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36d39e-abaf-4cf8-8544-7141a9873807 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:17.716184 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36d39e-abaf-4cf8-8544-7141a9873807 service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:17.716461 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36d39e-abaf-4cf8-8544-7141a9873807 service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:17.716728 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36d39e-abaf-4cf8-8544-7141a9873807 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:17.725649 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36d39e-abaf-4cf8-8544-7141a9873807 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:17.727226 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36d39e-abaf-4cf8-8544-7141a9873807 service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:17.736750 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 505/1036] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:18.622283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581b2f4-220d-46e1-95c5-73aa6bf20f2c None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:18.622818 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581b2f4-220d-46e1-95c5-73aa6bf20f2c None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:18.622818 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581b2f4-220d-46e1-95c5-73aa6bf20f2c None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:18.624131 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 532/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 01:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:18.629392 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645ccc6-d44d-4744-8544-417d6cafd738 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:18.629813 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645ccc6-d44d-4744-8544-417d6cafd738 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:18.629927 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645ccc6-d44d-4744-8544-417d6cafd738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:18.649475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-8645ccc6-d44d-4744-8544-417d6cafd738 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:18.652021 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-8645ccc6-d44d-4744-8544-417d6cafd738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:18.658372 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 506/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 01:22:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:18.817446 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581b2f4-220d-46e1-95c5-73aa6bf20f2c None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:18.830795 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581b2f4-220d-46e1-95c5-73aa6bf20f2c None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:18.836527 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50677ae-f21b-4b77-960e-01ff7b851a49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:18.837215 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50677ae-f21b-4b77-960e-01ff7b851a49 service nova] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:18.837550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50677ae-f21b-4b77-960e-01ff7b851a49 service nova] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:18.837821 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50677ae-f21b-4b77-960e-01ff7b851a49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:18.846118 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50677ae-f21b-4b77-960e-01ff7b851a49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:18.848319 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50677ae-f21b-4b77-960e-01ff7b851a49 service nova] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:18.857881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 533/1039] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:19.727902 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1a52a-9db3-42d5-bab2-72264dec30d9 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:19.728499 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1a52a-9db3-42d5-bab2-72264dec30d9 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:19.728499 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1a52a-9db3-42d5-bab2-72264dec30d9 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:19.729808 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 507/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 01:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:19.734752 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330c14b-8ee4-4b69-b2d5-35390d8bffe9 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:19.735156 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330c14b-8ee4-4b69-b2d5-35390d8bffe9 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:19.735340 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330c14b-8ee4-4b69-b2d5-35390d8bffe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:19.756065 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-1330c14b-8ee4-4b69-b2d5-35390d8bffe9 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:19.757283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-1330c14b-8ee4-4b69-b2d5-35390d8bffe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:19.765192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 534/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 01:22:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:19.919696 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1a52a-9db3-42d5-bab2-72264dec30d9 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:19.934696 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1a52a-9db3-42d5-bab2-72264dec30d9 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:19.939591 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b77ee-f5d2-460c-883c-b3e31b27c1d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:19.940208 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b77ee-f5d2-460c-883c-b3e31b27c1d5 service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:19.940511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b77ee-f5d2-460c-883c-b3e31b27c1d5 service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:19.941856 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b77ee-f5d2-460c-883c-b3e31b27c1d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:19.949964 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b77ee-f5d2-460c-883c-b3e31b27c1d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:19.951551 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b77ee-f5d2-460c-883c-b3e31b27c1d5 service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:19.961516 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 508/1042] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:20.845960 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fc8c3-32e0-465f-8a8d-e05b22b46b78 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:20.846528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fc8c3-32e0-465f-8a8d-e05b22b46b78 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:20.846528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fc8c3-32e0-465f-8a8d-e05b22b46b78 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:20.848800 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 535/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 01:22:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:20.853599 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6510f-ef26-4b89-bb36-0613864b97f7 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:20.854018 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6510f-ef26-4b89-bb36-0613864b97f7 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:20.854154 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6510f-ef26-4b89-bb36-0613864b97f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:20.875001 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-0ba6510f-ef26-4b89-bb36-0613864b97f7 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:20.876211 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-0ba6510f-ef26-4b89-bb36-0613864b97f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:20.884600 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 509/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 01:22:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:21.043954 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fc8c3-32e0-465f-8a8d-e05b22b46b78 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:21.057618 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fc8c3-32e0-465f-8a8d-e05b22b46b78 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:21.062529 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded6a54-280e-43fd-a151-59580adcff0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:21.063111 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded6a54-280e-43fd-a151-59580adcff0d service nova] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:21.063389 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded6a54-280e-43fd-a151-59580adcff0d service nova] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:21.063660 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded6a54-280e-43fd-a151-59580adcff0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:21.072530 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded6a54-280e-43fd-a151-59580adcff0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:21.074132 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded6a54-280e-43fd-a151-59580adcff0d service nova] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:21.084168 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 536/1045] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:21.964961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556b4f0-3ecb-4b7e-8fad-f32c57980121 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:21.965478 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556b4f0-3ecb-4b7e-8fad-f32c57980121 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:21.965594 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556b4f0-3ecb-4b7e-8fad-f32c57980121 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:21.966870 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 510/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 01:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:21.972090 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7f2c6-924e-4c73-a4a5-a519ba265a5c None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:21.972493 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7f2c6-924e-4c73-a4a5-a519ba265a5c None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:21.972670 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7f2c6-924e-4c73-a4a5-a519ba265a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:21.992099 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-e3e7f2c6-924e-4c73-a4a5-a519ba265a5c None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:21.993334 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-e3e7f2c6-924e-4c73-a4a5-a519ba265a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:22.001031 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 537/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 01:22:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:22.156740 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556b4f0-3ecb-4b7e-8fad-f32c57980121 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:22.170590 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556b4f0-3ecb-4b7e-8fad-f32c57980121 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:22.176464 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003f42d-0bfa-4a65-97ec-1899dfc2e2e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:22.177087 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003f42d-0bfa-4a65-97ec-1899dfc2e2e4 service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:22.177365 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003f42d-0bfa-4a65-97ec-1899dfc2e2e4 service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:22.177634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003f42d-0bfa-4a65-97ec-1899dfc2e2e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:22.185676 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003f42d-0bfa-4a65-97ec-1899dfc2e2e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:22.187247 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003f42d-0bfa-4a65-97ec-1899dfc2e2e4 service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:22.197478 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 511/1048] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:23.090684 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c23138-fc0f-4005-90c8-6ec7f3413e73 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:23.091231 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c23138-fc0f-4005-90c8-6ec7f3413e73 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:23.091231 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c23138-fc0f-4005-90c8-6ec7f3413e73 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:23.092556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 538/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 01:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:23.098116 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1349a1-fc6a-4df1-99da-24e0d32c4ed9 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:23.098536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1349a1-fc6a-4df1-99da-24e0d32c4ed9 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:23.098666 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1349a1-fc6a-4df1-99da-24e0d32c4ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:23.117821 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-ad1349a1-fc6a-4df1-99da-24e0d32c4ed9 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:23.119015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-ad1349a1-fc6a-4df1-99da-24e0d32c4ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:23.126674 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 512/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 01:22:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:23.284114 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c23138-fc0f-4005-90c8-6ec7f3413e73 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:23.301319 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c23138-fc0f-4005-90c8-6ec7f3413e73 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:23.308789 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f44398-b9b0-4c16-a3b8-584d7d51f52f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:23.309550 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f44398-b9b0-4c16-a3b8-584d7d51f52f service nova] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:23.309826 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f44398-b9b0-4c16-a3b8-584d7d51f52f service nova] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:23.310090 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f44398-b9b0-4c16-a3b8-584d7d51f52f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:23.319806 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f44398-b9b0-4c16-a3b8-584d7d51f52f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:23.321462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f44398-b9b0-4c16-a3b8-584d7d51f52f service nova] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:23.330739 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 539/1051] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:24.210498 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f57a1-336b-43ec-9df6-a50f9ff59cb0 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:24.211033 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f57a1-336b-43ec-9df6-a50f9ff59cb0 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:24.211033 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f57a1-336b-43ec-9df6-a50f9ff59cb0 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:24.212301 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 513/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 01:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:24.217205 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cba05-f2a4-45f9-9ca2-529d9db0c444 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:24.217643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cba05-f2a4-45f9-9ca2-529d9db0c444 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:24.217755 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cba05-f2a4-45f9-9ca2-529d9db0c444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:24.236413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-f87cba05-f2a4-45f9-9ca2-529d9db0c444 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:24.238142 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-f87cba05-f2a4-45f9-9ca2-529d9db0c444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:24.245842 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 540/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 01:22:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:24.402156 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f57a1-336b-43ec-9df6-a50f9ff59cb0 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:24.415593 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f57a1-336b-43ec-9df6-a50f9ff59cb0 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:24.420446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca2196-34b0-48cf-b6e6-b18190c96bdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:24.421058 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca2196-34b0-48cf-b6e6-b18190c96bdb service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:24.421337 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca2196-34b0-48cf-b6e6-b18190c96bdb service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:24.421609 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca2196-34b0-48cf-b6e6-b18190c96bdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:24.430557 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca2196-34b0-48cf-b6e6-b18190c96bdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:24.432136 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca2196-34b0-48cf-b6e6-b18190c96bdb service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:24.444674 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 514/1054] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:25.357309 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331437c-c397-4cb8-a9ac-107cd6aecb58 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:25.357929 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331437c-c397-4cb8-a9ac-107cd6aecb58 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:25.358185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331437c-c397-4cb8-a9ac-107cd6aecb58 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:25.359906 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 541/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 01:22:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:25.366196 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d98bf-a735-4bfb-a32d-3c06056732da None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:25.366625 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d98bf-a735-4bfb-a32d-3c06056732da None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:25.366751 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d98bf-a735-4bfb-a32d-3c06056732da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:25.386304 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-206d98bf-a735-4bfb-a32d-3c06056732da None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:25.387755 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-206d98bf-a735-4bfb-a32d-3c06056732da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:25.396297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 515/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 01:22:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:25.583801 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331437c-c397-4cb8-a9ac-107cd6aecb58 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:25.597650 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331437c-c397-4cb8-a9ac-107cd6aecb58 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:25.604219 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0eea7-1fff-4288-be84-276b0369d9c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:25.604810 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0eea7-1fff-4288-be84-276b0369d9c6 service nova] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:25.605126 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0eea7-1fff-4288-be84-276b0369d9c6 service nova] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:25.605392 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0eea7-1fff-4288-be84-276b0369d9c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:25.613669 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0eea7-1fff-4288-be84-276b0369d9c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:25.615192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0eea7-1fff-4288-be84-276b0369d9c6 service nova] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:25.624464 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 542/1057] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:27.683257 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea3d6e-8014-4be1-ba98-e594cc5096e7 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:27.683818 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea3d6e-8014-4be1-ba98-e594cc5096e7 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:27.683818 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea3d6e-8014-4be1-ba98-e594cc5096e7 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:27.685159 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 516/1058] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:27.690621 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee551d-b645-4ef2-adb2-16ef9cead64f None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:27.691035 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee551d-b645-4ef2-adb2-16ef9cead64f None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:27.691174 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee551d-b645-4ef2-adb2-16ef9cead64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:27.709981 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-dbee551d-b645-4ef2-adb2-16ef9cead64f None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:27.711176 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-dbee551d-b645-4ef2-adb2-16ef9cead64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:27.718835 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 543/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:22:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:28.062614 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea3d6e-8014-4be1-ba98-e594cc5096e7 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:28.074300 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea3d6e-8014-4be1-ba98-e594cc5096e7 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:28.077762 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde1501-e4e6-467d-9918-c0c9ec69e899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:28.078350 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde1501-e4e6-467d-9918-c0c9ec69e899 service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:28.078625 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde1501-e4e6-467d-9918-c0c9ec69e899 service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:28.078894 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde1501-e4e6-467d-9918-c0c9ec69e899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:28.087852 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde1501-e4e6-467d-9918-c0c9ec69e899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:28.089327 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde1501-e4e6-467d-9918-c0c9ec69e899 service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:28.099027 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 517/1060] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:30.436971 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c070e99-d941-4ccd-a568-fd271a3c47fb None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:30.437587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c070e99-d941-4ccd-a568-fd271a3c47fb None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:30.437587 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c070e99-d941-4ccd-a568-fd271a3c47fb None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:30.438858 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 544/1061] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:30.444747 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade176ff-6724-478d-ba58-50c4ddb69b39 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:30.445240 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade176ff-6724-478d-ba58-50c4ddb69b39 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:30.445363 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade176ff-6724-478d-ba58-50c4ddb69b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:30.464475 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-ade176ff-6724-478d-ba58-50c4ddb69b39 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:30.465719 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-ade176ff-6724-478d-ba58-50c4ddb69b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:30.473913 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 518/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:22:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:30.819944 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c070e99-d941-4ccd-a568-fd271a3c47fb None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:30.830778 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c070e99-d941-4ccd-a568-fd271a3c47fb None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:30.834837 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ce1cb-827e-433e-adde-e7340be4b42d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:30.835433 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ce1cb-827e-433e-adde-e7340be4b42d service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:30.835709 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ce1cb-827e-433e-adde-e7340be4b42d service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:30.835975 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ce1cb-827e-433e-adde-e7340be4b42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:30.845078 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ce1cb-827e-433e-adde-e7340be4b42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:30.847027 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ce1cb-827e-433e-adde-e7340be4b42d service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:30.856412 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 545/1063] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:33.418593 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd0c4e-317c-4ff7-9477-b5ed4005e307 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:33.419156 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd0c4e-317c-4ff7-9477-b5ed4005e307 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:33.419156 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd0c4e-317c-4ff7-9477-b5ed4005e307 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:33.420462 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 519/1064] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:33.425627 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5ef36-5dbb-488b-8294-b7d0dcfc72b7 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:33.426068 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5ef36-5dbb-488b-8294-b7d0dcfc72b7 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:33.426183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5ef36-5dbb-488b-8294-b7d0dcfc72b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:33.445053 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-b1f5ef36-5dbb-488b-8294-b7d0dcfc72b7 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:33.446248 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-b1f5ef36-5dbb-488b-8294-b7d0dcfc72b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:33.453980 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 546/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:22:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:33.800386 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd0c4e-317c-4ff7-9477-b5ed4005e307 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:33.811062 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd0c4e-317c-4ff7-9477-b5ed4005e307 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:33.814594 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f78e1-d62e-4751-895b-8b9fa7d5486a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:33.815173 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f78e1-d62e-4751-895b-8b9fa7d5486a service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:33.815455 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f78e1-d62e-4751-895b-8b9fa7d5486a service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:33.815727 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f78e1-d62e-4751-895b-8b9fa7d5486a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:33.824691 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f78e1-d62e-4751-895b-8b9fa7d5486a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:33.826246 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f78e1-d62e-4751-895b-8b9fa7d5486a service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:33.835952 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 520/1066] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:36.179370 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86383daf-2402-4c10-bbbc-7fb07012b3da None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:36.180171 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86383daf-2402-4c10-bbbc-7fb07012b3da None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:36.180171 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86383daf-2402-4c10-bbbc-7fb07012b3da None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:36.182178 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 547/1067] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:36.188278 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccda0d-826c-48ab-89bb-3501ed358cc3 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:36.188976 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccda0d-826c-48ab-89bb-3501ed358cc3 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:36.189264 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccda0d-826c-48ab-89bb-3501ed358cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:36.213904 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-a4ccda0d-826c-48ab-89bb-3501ed358cc3 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:36.215123 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-a4ccda0d-826c-48ab-89bb-3501ed358cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:36.226365 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 521/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:22:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:36.635183 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86383daf-2402-4c10-bbbc-7fb07012b3da None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:36.649337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86383daf-2402-4c10-bbbc-7fb07012b3da None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:36.653130 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2b151-8904-4b7d-8823-81eaa3e906dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:36.653740 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2b151-8904-4b7d-8823-81eaa3e906dd service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:36.654008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2b151-8904-4b7d-8823-81eaa3e906dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:36.654275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2b151-8904-4b7d-8823-81eaa3e906dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:36.664090 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2b151-8904-4b7d-8823-81eaa3e906dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:36.665561 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2b151-8904-4b7d-8823-81eaa3e906dd service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:36.675863 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 548/1069] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:38.940909 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68b622-e347-4f16-98f5-a05ea961bec4 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:38.941444 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68b622-e347-4f16-98f5-a05ea961bec4 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:38.941444 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68b622-e347-4f16-98f5-a05ea961bec4 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:38.942778 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 522/1070] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:38.947989 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ebbc-878d-4266-9513-cb58fbeb8173 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:38.948414 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ebbc-878d-4266-9513-cb58fbeb8173 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:38.948529 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4ebbc-878d-4266-9513-cb58fbeb8173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:38.970452 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-c1b4ebbc-878d-4266-9513-cb58fbeb8173 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:38.972429 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-c1b4ebbc-878d-4266-9513-cb58fbeb8173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:38.980214 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 549/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:22:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:39.322680 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68b622-e347-4f16-98f5-a05ea961bec4 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:39.334067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68b622-e347-4f16-98f5-a05ea961bec4 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:39.337549 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45c25b-c88a-4542-a270-9695938f87c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:39.338128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c25b-c88a-4542-a270-9695938f87c6 service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:39.338402 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c25b-c88a-4542-a270-9695938f87c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:39.338668 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c25b-c88a-4542-a270-9695938f87c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:39.348297 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45c25b-c88a-4542-a270-9695938f87c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:39.349798 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45c25b-c88a-4542-a270-9695938f87c6 service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:39.358917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 523/1072] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:41.700715 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c4dc0-12ec-47b2-8d3e-01d49780d206 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:41.701299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c4dc0-12ec-47b2-8d3e-01d49780d206 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:41.701299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c4dc0-12ec-47b2-8d3e-01d49780d206 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:41.702630 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 550/1073] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:41.708662 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494306-c87b-4943-b996-6289021079db None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:41.709111 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494306-c87b-4943-b996-6289021079db None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:41.709275 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494306-c87b-4943-b996-6289021079db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:41.728515 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-9c494306-c87b-4943-b996-6289021079db None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:41.729735 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-9c494306-c87b-4943-b996-6289021079db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:41.737415 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 524/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:22:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:42.071033 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c4dc0-12ec-47b2-8d3e-01d49780d206 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:42.082162 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c4dc0-12ec-47b2-8d3e-01d49780d206 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:42.085596 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444dad3-68fd-4be8-a1d4-ceaa33df065a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:42.086181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444dad3-68fd-4be8-a1d4-ceaa33df065a service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:42.086451 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444dad3-68fd-4be8-a1d4-ceaa33df065a service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:42.086713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444dad3-68fd-4be8-a1d4-ceaa33df065a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:42.096021 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444dad3-68fd-4be8-a1d4-ceaa33df065a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:42.097516 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444dad3-68fd-4be8-a1d4-ceaa33df065a service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:42.107908 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 551/1075] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:44.353307 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00051192-6f04-49cc-8262-55f3a1bc43e1 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:44.353843 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00051192-6f04-49cc-8262-55f3a1bc43e1 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:44.353843 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00051192-6f04-49cc-8262-55f3a1bc43e1 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:44.355203 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 525/1076] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:44.360449 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53b3ce-25e9-4cd7-8934-2bbfeb4794ce None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:44.361023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53b3ce-25e9-4cd7-8934-2bbfeb4794ce None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:44.361208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53b3ce-25e9-4cd7-8934-2bbfeb4794ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:44.368553 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=70 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:22:44.381084 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-6a53b3ce-25e9-4cd7-8934-2bbfeb4794ce None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:44.382294 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-6a53b3ce-25e9-4cd7-8934-2bbfeb4794ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:44.390361 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 552/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:22:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:44.728272 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00051192-6f04-49cc-8262-55f3a1bc43e1 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:44.733623 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=73 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:22:44.739362 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00051192-6f04-49cc-8262-55f3a1bc43e1 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:44.742808 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5deb0-63bb-4f8c-b5ad-786ffcbc18d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:44.746682 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5deb0-63bb-4f8c-b5ad-786ffcbc18d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:44.746682 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5deb0-63bb-4f8c-b5ad-786ffcbc18d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:44.746682 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5deb0-63bb-4f8c-b5ad-786ffcbc18d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:44.752971 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5deb0-63bb-4f8c-b5ad-786ffcbc18d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:44.754404 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5deb0-63bb-4f8c-b5ad-786ffcbc18d9 service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:44.763809 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 526/1078] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:46.997923 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d15747-52b6-4f67-bcc0-1f20d1a4d8d3 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:46.998510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d15747-52b6-4f67-bcc0-1f20d1a4d8d3 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:46.998510 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d15747-52b6-4f67-bcc0-1f20d1a4d8d3 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:46.999832 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 553/1079] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:47.005719 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3675ba-f030-4e90-9fbe-ec8dca6b902c None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:47.006134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3675ba-f030-4e90-9fbe-ec8dca6b902c None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:47.006250 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3675ba-f030-4e90-9fbe-ec8dca6b902c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:47.025042 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-2d3675ba-f030-4e90-9fbe-ec8dca6b902c None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:47.026228 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-2d3675ba-f030-4e90-9fbe-ec8dca6b902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:47.034771 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 527/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:22:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:47.384983 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d15747-52b6-4f67-bcc0-1f20d1a4d8d3 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:47.396668 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d15747-52b6-4f67-bcc0-1f20d1a4d8d3 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:47.400058 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899be304-d859-48f1-8f23-03aec36da63c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:47.400644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899be304-d859-48f1-8f23-03aec36da63c service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:47.400956 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899be304-d859-48f1-8f23-03aec36da63c service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:47.401228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899be304-d859-48f1-8f23-03aec36da63c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:47.409869 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899be304-d859-48f1-8f23-03aec36da63c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:47.411283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899be304-d859-48f1-8f23-03aec36da63c service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:47.420338 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 554/1081] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:49.613039 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f617d4-bdc9-49e0-b149-e260b524daea None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:49.613604 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f617d4-bdc9-49e0-b149-e260b524daea None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:49.613604 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f617d4-bdc9-49e0-b149-e260b524daea None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:49.614910 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 528/1082] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:49.620263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3b4ce-8f64-4280-9cf3-68762d2252c4 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:49.620698 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3b4ce-8f64-4280-9cf3-68762d2252c4 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:49.620810 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3b4ce-8f64-4280-9cf3-68762d2252c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:49.640073 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-5fa3b4ce-8f64-4280-9cf3-68762d2252c4 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:49.641299 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-5fa3b4ce-8f64-4280-9cf3-68762d2252c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:49.649440 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 555/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:22:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:49.994153 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f617d4-bdc9-49e0-b149-e260b524daea None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:50.004823 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f617d4-bdc9-49e0-b149-e260b524daea None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:50.008253 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5791884-cfa0-4d0f-b78c-4a9f5717d27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:50.008836 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5791884-cfa0-4d0f-b78c-4a9f5717d27e service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:50.009142 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5791884-cfa0-4d0f-b78c-4a9f5717d27e service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:50.009411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5791884-cfa0-4d0f-b78c-4a9f5717d27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:50.018779 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5791884-cfa0-4d0f-b78c-4a9f5717d27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:50.020204 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5791884-cfa0-4d0f-b78c-4a9f5717d27e service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:50.029759 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 529/1084] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:22:52.240904 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86ba5a-6899-4675-8216-8dc08185bcd6 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:52.241460 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86ba5a-6899-4675-8216-8dc08185bcd6 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:52.241460 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86ba5a-6899-4675-8216-8dc08185bcd6 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:52.242707 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 556/1085] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:22:52.248017 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f56d0-139f-4cab-a6b3-1cda42b09800 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:52.248471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f56d0-139f-4cab-a6b3-1cda42b09800 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:52.248571 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f56d0-139f-4cab-a6b3-1cda42b09800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:52.268733 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-b47f56d0-139f-4cab-a6b3-1cda42b09800 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:22:52.269954 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-b47f56d0-139f-4cab-a6b3-1cda42b09800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:22:52.277644 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 530/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:22:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:22:52.623451 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86ba5a-6899-4675-8216-8dc08185bcd6 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:22:52.634167 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86ba5a-6899-4675-8216-8dc08185bcd6 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:22:52.637900 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e42ad8-448a-4560-bed0-e6dd4457d826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:22:52.638483 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e42ad8-448a-4560-bed0-e6dd4457d826 service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:22:52.638757 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e42ad8-448a-4560-bed0-e6dd4457d826 service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:22:52.639022 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e42ad8-448a-4560-bed0-e6dd4457d826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:22:52.647810 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e42ad8-448a-4560-bed0-e6dd4457d826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:22:52.649269 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e42ad8-448a-4560-bed0-e6dd4457d826 service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:22:52.658884 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 557/1087] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:22:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:23:02.264062 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=17 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:23:02.654344 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=17 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:23:16.791634 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d8de9-acbf-4e20-978b-088d9934a69e None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:16.792198 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d8de9-acbf-4e20-978b-088d9934a69e None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:16.792198 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d8de9-acbf-4e20-978b-088d9934a69e None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:16.793512 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 531/1088] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:23:16.799279 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3b0e7-91d1-41ec-baa0-53769d5a0299 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:16.799667 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3b0e7-91d1-41ec-baa0-53769d5a0299 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:16.799824 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3b0e7-91d1-41ec-baa0-53769d5a0299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:16.818573 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-20a3b0e7-91d1-41ec-baa0-53769d5a0299 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:23:16.819718 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-20a3b0e7-91d1-41ec-baa0-53769d5a0299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:23:16.828071 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 558/1089] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:23:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:23:17.183575 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bafd03-76cb-4c53-97f0-687c854e6807 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:17.183858 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bafd03-76cb-4c53-97f0-687c854e6807 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:17.184127 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bafd03-76cb-4c53-97f0-687c854e6807 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:17.185461 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 532/1090] 10.222.0.82 () {54 vars in 967 bytes} [Fri Aug 19 01:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:23:17.191273 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194468b-e8fb-4dac-b558-962ed9d12e93 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:17.191588 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194468b-e8fb-4dac-b558-962ed9d12e93 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:17.191868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194468b-e8fb-4dac-b558-962ed9d12e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:17.212242 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-6194468b-e8fb-4dac-b558-962ed9d12e93 None None] MFA Rules not processed for user `0cd2faa457434dc6bfec69ecfa952ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:23:17.213463 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-6194468b-e8fb-4dac-b558-962ed9d12e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:23:17.220249 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 559/1091] 10.222.0.82 () {58 vars in 1064 bytes} [Fri Aug 19 01:23:17 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:23:17.227474 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bafd03-76cb-4c53-97f0-687c854e6807 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:23:17.238573 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bafd03-76cb-4c53-97f0-687c854e6807 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:23:17.242028 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a5252-00fd-4bfc-9bde-cb70857aa14c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd2faa457434dc6bfec69ecfa952ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:23:17.242614 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a5252-00fd-4bfc-9bde-cb70857aa14c service glance] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:17.242886 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a5252-00fd-4bfc-9bde-cb70857aa14c service glance] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:17.243153 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a5252-00fd-4bfc-9bde-cb70857aa14c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:17.252969 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a5252-00fd-4bfc-9bde-cb70857aa14c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:23:17.254416 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a5252-00fd-4bfc-9bde-cb70857aa14c service glance] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:23:17.263830 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 533/1092] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:23:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 01:23:19.573646 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7e078-7835-4c4d-8472-75c5770e291b None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:19.574143 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7e078-7835-4c4d-8472-75c5770e291b None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:19.574248 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7e078-7835-4c4d-8472-75c5770e291b None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:19.575528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 560/1093] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:23:19.580629 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8a7dc-fbba-419a-a050-be98b80a4b08 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:19.581082 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8a7dc-fbba-419a-a050-be98b80a4b08 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:19.581194 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8a7dc-fbba-419a-a050-be98b80a4b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:19.601071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-65c8a7dc-fbba-419a-a050-be98b80a4b08 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:23:19.602269 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-65c8a7dc-fbba-419a-a050-be98b80a4b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:23:19.610612 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 534/1094] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:23:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:23:19.954677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7e078-7835-4c4d-8472-75c5770e291b None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:23:19.967116 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7e078-7835-4c4d-8472-75c5770e291b None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:23:19.972166 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69497427-86c1-4a3f-8a4e-259d6851ed85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:23:19.972762 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69497427-86c1-4a3f-8a4e-259d6851ed85 admin admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:19.973072 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69497427-86c1-4a3f-8a4e-259d6851ed85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:19.973347 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69497427-86c1-4a3f-8a4e-259d6851ed85 admin admin] PATH_INFO: `/v3/projects` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:19.973979 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69497427-86c1-4a3f-8a4e-259d6851ed85 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:23:19.975728 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: WARNING py.warnings [None req-69497427-86c1-4a3f-8a4e-259d6851ed85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:23:19.975728 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: warnings.warn(msg) Aug 19 01:23:19.975728 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: Aug 19 01:23:19.976972 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69497427-86c1-4a3f-8a4e-259d6851ed85 admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:23:19.995227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 561/1095] 10.222.0.82 () {56 vars in 1108 bytes} [Fri Aug 19 01:23:19 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:23:22.209659 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c276b-f8ae-466f-8ad0-0bda51237a5f None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:22.210246 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c276b-f8ae-466f-8ad0-0bda51237a5f None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:22.210246 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c276b-f8ae-466f-8ad0-0bda51237a5f None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:22.211516 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 535/1096] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:23:22.216677 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ad6a1-d4ae-4f6d-8686-6b2326422b43 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:22.217171 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ad6a1-d4ae-4f6d-8686-6b2326422b43 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:22.217276 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ad6a1-d4ae-4f6d-8686-6b2326422b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:22.236688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-191ad6a1-d4ae-4f6d-8686-6b2326422b43 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:23:22.237921 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-191ad6a1-d4ae-4f6d-8686-6b2326422b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:23:22.245695 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 562/1097] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:23:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:23:22.601402 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c276b-f8ae-466f-8ad0-0bda51237a5f None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:23:22.615382 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c276b-f8ae-466f-8ad0-0bda51237a5f None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:23:22.627684 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38504db7-57a8-4809-a553-7741824e8fee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:23:22.627684 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38504db7-57a8-4809-a553-7741824e8fee service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:22.627684 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38504db7-57a8-4809-a553-7741824e8fee service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:22.627684 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38504db7-57a8-4809-a553-7741824e8fee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:22.629494 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38504db7-57a8-4809-a553-7741824e8fee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:23:22.631113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38504db7-57a8-4809-a553-7741824e8fee service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:23:22.644128 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 536/1098] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:23:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:23:25.028061 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e21fa-3235-4f21-9904-651ecc7ba116 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:25.028659 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e21fa-3235-4f21-9904-651ecc7ba116 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:25.028659 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e21fa-3235-4f21-9904-651ecc7ba116 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:25.029980 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 563/1099] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:23:25.035524 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d9092-848f-4de9-b851-0b5d938fdccf None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:25.035940 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d9092-848f-4de9-b851-0b5d938fdccf None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:25.036073 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d9092-848f-4de9-b851-0b5d938fdccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:25.056258 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-790d9092-848f-4de9-b851-0b5d938fdccf None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:23:25.057476 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-790d9092-848f-4de9-b851-0b5d938fdccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:23:25.066275 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 537/1100] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:23:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:23:25.412820 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e21fa-3235-4f21-9904-651ecc7ba116 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:23:25.424330 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e21fa-3235-4f21-9904-651ecc7ba116 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:23:25.428029 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309bb78-7d6d-4b73-a08f-a40f8ab2fccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:23:25.428629 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309bb78-7d6d-4b73-a08f-a40f8ab2fccc service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:25.428953 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309bb78-7d6d-4b73-a08f-a40f8ab2fccc service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:25.429228 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309bb78-7d6d-4b73-a08f-a40f8ab2fccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:25.438427 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309bb78-7d6d-4b73-a08f-a40f8ab2fccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:23:25.439875 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309bb78-7d6d-4b73-a08f-a40f8ab2fccc service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:23:25.449202 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 564/1101] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:23:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:23:27.728564 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c00dfd-ef23-4e9d-97a9-2e5fba8bc40b None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:27.729151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c00dfd-ef23-4e9d-97a9-2e5fba8bc40b None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:27.729151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c00dfd-ef23-4e9d-97a9-2e5fba8bc40b None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:27.730494 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 538/1102] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:23:27.736693 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5409c68-5a63-4cce-87d0-7254c491997e None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:27.737224 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5409c68-5a63-4cce-87d0-7254c491997e None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:27.737337 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5409c68-5a63-4cce-87d0-7254c491997e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:27.758171 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-a5409c68-5a63-4cce-87d0-7254c491997e None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:23:27.759371 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-a5409c68-5a63-4cce-87d0-7254c491997e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:23:27.768568 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 565/1103] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:23:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:23:28.118566 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c00dfd-ef23-4e9d-97a9-2e5fba8bc40b None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:23:28.129924 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c00dfd-ef23-4e9d-97a9-2e5fba8bc40b None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:23:28.133369 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556b7fe-7cb0-4cf8-86ec-d02f1d482aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:23:28.133955 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556b7fe-7cb0-4cf8-86ec-d02f1d482aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:28.134234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556b7fe-7cb0-4cf8-86ec-d02f1d482aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:28.134504 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556b7fe-7cb0-4cf8-86ec-d02f1d482aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:28.143624 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556b7fe-7cb0-4cf8-86ec-d02f1d482aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:23:28.145090 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556b7fe-7cb0-4cf8-86ec-d02f1d482aa4 service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:23:28.154298 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 539/1104] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:23:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:23:30.413364 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b308-67ea-4323-9c0c-db9e4643032c None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:30.413877 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b308-67ea-4323-9c0c-db9e4643032c None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:30.413989 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b308-67ea-4323-9c0c-db9e4643032c None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:30.415258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 566/1105] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:23:30.421037 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c738e44-2e74-4e86-b13f-3886b64632f2 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:30.421524 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c738e44-2e74-4e86-b13f-3886b64632f2 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:30.421635 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c738e44-2e74-4e86-b13f-3886b64632f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:30.440699 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-7c738e44-2e74-4e86-b13f-3886b64632f2 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:23:30.441904 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-7c738e44-2e74-4e86-b13f-3886b64632f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:23:30.449465 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 540/1106] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:23:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:23:30.797485 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627b308-67ea-4323-9c0c-db9e4643032c None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:23:30.808234 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627b308-67ea-4323-9c0c-db9e4643032c None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:23:30.811745 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2bc35-8aac-494c-b3b2-50085cde0d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:23:30.812336 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2bc35-8aac-494c-b3b2-50085cde0d8e service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:30.812616 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2bc35-8aac-494c-b3b2-50085cde0d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:30.812926 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2bc35-8aac-494c-b3b2-50085cde0d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:30.821594 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2bc35-8aac-494c-b3b2-50085cde0d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:23:30.823018 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2bc35-8aac-494c-b3b2-50085cde0d8e service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:23:30.832831 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 567/1107] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:23:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:23:33.395241 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8607-a24e-4f54-9366-2de6b506c561 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:33.395809 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8607-a24e-4f54-9366-2de6b506c561 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:33.395809 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8607-a24e-4f54-9366-2de6b506c561 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:33.397240 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 541/1108] 10.222.0.82 () {54 vars in 927 bytes} [Fri Aug 19 01:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:23:33.402627 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc081c-15cd-4de3-ab22-b2eb2e1d6c72 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:33.410221 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc081c-15cd-4de3-ab22-b2eb2e1d6c72 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:33.410221 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc081c-15cd-4de3-ab22-b2eb2e1d6c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:33.423470 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-81cc081c-15cd-4de3-ab22-b2eb2e1d6c72 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:23:33.424672 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-81cc081c-15cd-4de3-ab22-b2eb2e1d6c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:23:33.432665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 568/1109] 10.222.0.82 () {58 vars in 1024 bytes} [Fri Aug 19 01:23:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:23:33.785929 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb8607-a24e-4f54-9366-2de6b506c561 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:23:33.797134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb8607-a24e-4f54-9366-2de6b506c561 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:23:33.800541 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b59c5-6876-4be3-8115-091746182434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:23:33.801148 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b59c5-6876-4be3-8115-091746182434 service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:23:33.801422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b59c5-6876-4be3-8115-091746182434 service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:23:33.801685 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b59c5-6876-4be3-8115-091746182434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:23:33.810164 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b59c5-6876-4be3-8115-091746182434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:23:33.811673 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b59c5-6876-4be3-8115-091746182434 service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:23:33.821085 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 542/1110] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:23:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:23:43.417600 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=33 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:23:43.817133 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=33 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:24:56.945217 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf19cc-cb61-41f0-9b70-88f5e4103bb3 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:56.945816 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf19cc-cb61-41f0-9b70-88f5e4103bb3 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:56.945816 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf19cc-cb61-41f0-9b70-88f5e4103bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:56.965855 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-07cf19cc-cb61-41f0-9b70-88f5e4103bb3 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:24:56.967980 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-07cf19cc-cb61-41f0-9b70-88f5e4103bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:24:56.975626 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 569/1111] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:24:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:24:56.983484 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c4e40-76d9-4f67-91a6-d0d1d8fdd03d None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:56.983991 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c4e40-76d9-4f67-91a6-d0d1d8fdd03d None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:56.984098 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c4e40-76d9-4f67-91a6-d0d1d8fdd03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:57.002839 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-7c4c4e40-76d9-4f67-91a6-d0d1d8fdd03d None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:24:57.004024 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-7c4c4e40-76d9-4f67-91a6-d0d1d8fdd03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:24:57.011888 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 543/1112] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:24:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:24:57.017075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf19cc-cb61-41f0-9b70-88f5e4103bb3 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:24:57.026562 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf19cc-cb61-41f0-9b70-88f5e4103bb3 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:24:57.032101 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa8587-69a6-41ee-912d-4d86c6cfc293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:24:57.032688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa8587-69a6-41ee-912d-4d86c6cfc293 admin admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:57.033008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa8587-69a6-41ee-912d-4d86c6cfc293 admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:57.033279 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa8587-69a6-41ee-912d-4d86c6cfc293 admin admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:57.033911 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa8587-69a6-41ee-912d-4d86c6cfc293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:24:57.034208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa8587-69a6-41ee-912d-4d86c6cfc293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:24:57.035213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: WARNING py.warnings [None req-11aa8587-69a6-41ee-912d-4d86c6cfc293 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:24:57.035213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: warnings.warn(msg) Aug 19 01:24:57.035213 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: Aug 19 01:24:57.036089 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa8587-69a6-41ee-912d-4d86c6cfc293 admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:24:57.047687 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 570/1113] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Aug 19 01:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:24:57.055593 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c4e40-76d9-4f67-91a6-d0d1d8fdd03d None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:24:57.064593 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c4e40-76d9-4f67-91a6-d0d1d8fdd03d None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:24:57.069154 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e06749-5491-4a24-a275-7716204f3834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:24:57.069742 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e06749-5491-4a24-a275-7716204f3834 admin admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:57.070035 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e06749-5491-4a24-a275-7716204f3834 admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:57.070284 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e06749-5491-4a24-a275-7716204f3834 admin admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:57.070898 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e06749-5491-4a24-a275-7716204f3834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:24:57.072693 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: WARNING py.warnings [None req-a5e06749-5491-4a24-a275-7716204f3834 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:24:57.072693 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: warnings.warn(msg) Aug 19 01:24:57.072693 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: Aug 19 01:24:57.073911 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e06749-5491-4a24-a275-7716204f3834 admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:24:57.173258 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 544/1114] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Aug 19 01:24:57 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:24:57.178378 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa8587-69a6-41ee-912d-4d86c6cfc293 admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:24:57.191286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa8587-69a6-41ee-912d-4d86c6cfc293 admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:24:57.250037 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8cafb-3b39-43e7-b83b-ccff80368b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:24:57.250037 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8cafb-3b39-43e7-b83b-ccff80368b43 admin admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:57.250349 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8cafb-3b39-43e7-b83b-ccff80368b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:57.250455 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8cafb-3b39-43e7-b83b-ccff80368b43 admin admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:57.251050 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8cafb-3b39-43e7-b83b-ccff80368b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:24:57.252067 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: WARNING py.warnings [None req-e2b8cafb-3b39-43e7-b83b-ccff80368b43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:24:57.252067 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: warnings.warn(msg) Aug 19 01:24:57.252067 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: Aug 19 01:24:57.253351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8cafb-3b39-43e7-b83b-ccff80368b43 admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:24:57.363373 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 571/1115] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Aug 19 01:24:57 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:24:57.367693 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e06749-5491-4a24-a275-7716204f3834 admin admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:24:57.378587 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e06749-5491-4a24-a275-7716204f3834 admin admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:24:57.383424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8f5b9-ae0e-4e03-af60-a1b0ab3ca2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:24:57.384023 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8f5b9-ae0e-4e03-af60-a1b0ab3ca2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:57.384304 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8f5b9-ae0e-4e03-af60-a1b0ab3ca2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:57.384576 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8f5b9-ae0e-4e03-af60-a1b0ab3ca2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:57.385251 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8f5b9-ae0e-4e03-af60-a1b0ab3ca2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:24:57.386266 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: WARNING py.warnings [None req-f2e8f5b9-ae0e-4e03-af60-a1b0ab3ca2b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:24:57.386266 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: warnings.warn(msg) Aug 19 01:24:57.386266 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: Aug 19 01:24:57.387215 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8f5b9-ae0e-4e03-af60-a1b0ab3ca2b7 admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:24:57.400663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 545/1116] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Aug 19 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:24:57.405263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8cafb-3b39-43e7-b83b-ccff80368b43 admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:24:57.415190 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8cafb-3b39-43e7-b83b-ccff80368b43 admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:24:57.420556 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fd892-b5f7-44fe-b093-79547e93f08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:24:57.421268 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fd892-b5f7-44fe-b093-79547e93f08b admin admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:57.421554 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fd892-b5f7-44fe-b093-79547e93f08b admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:57.421827 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fd892-b5f7-44fe-b093-79547e93f08b admin admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:57.422497 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fd892-b5f7-44fe-b093-79547e93f08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:24:57.423505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: WARNING py.warnings [None req-014fd892-b5f7-44fe-b093-79547e93f08b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:24:57.423505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: warnings.warn(msg) Aug 19 01:24:57.423505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: Aug 19 01:24:57.424421 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fd892-b5f7-44fe-b093-79547e93f08b admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:24:57.437635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 572/1117] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Aug 19 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:24:57.441628 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8f5b9-ae0e-4e03-af60-a1b0ab3ca2b7 admin admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:24:57.451741 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8f5b9-ae0e-4e03-af60-a1b0ab3ca2b7 admin admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:24:57.456264 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7718d-3eaa-42f0-ae41-b171a759f3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:24:57.456934 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7718d-3eaa-42f0-ae41-b171a759f3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:57.457217 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7718d-3eaa-42f0-ae41-b171a759f3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:57.457490 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7718d-3eaa-42f0-ae41-b171a759f3ed admin admin] PATH_INFO: `/v3/projects/5b4a465116734dfb8626a537a7f47140/users/390edf1f58654955a6c3e85ae8c101d3/roles/f8c07e35d799437cbb53316acc2fc030` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:57.472531 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7718d-3eaa-42f0-ae41-b171a759f3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4a465116734dfb8626a537a7f47140, user_id=390edf1f58654955a6c3e85ae8c101d3, role_id=f8c07e35d799437cbb53316acc2fc030)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:24:57.473610 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: WARNING py.warnings [None req-51a7718d-3eaa-42f0-ae41-b171a759f3ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:24:57.473610 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: warnings.warn(msg) Aug 19 01:24:57.473610 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: Aug 19 01:24:57.475544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7718d-3eaa-42f0-ae41-b171a759f3ed admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:24:57.583450 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 546/1118] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Aug 19 01:24:57 2022] PUT /identity/v3/projects/5b4a465116734dfb8626a537a7f47140/users/390edf1f58654955a6c3e85ae8c101d3/roles/f8c07e35d799437cbb53316acc2fc030 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:24:57.596504 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999d793-aba2-4a49-8994-222075a1e167 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:57.596794 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999d793-aba2-4a49-8994-222075a1e167 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:57.597095 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999d793-aba2-4a49-8994-222075a1e167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:57.625249 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-9999d793-aba2-4a49-8994-222075a1e167 None None] MFA Rules not processed for user `390edf1f58654955a6c3e85ae8c101d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:24:57.626431 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-9999d793-aba2-4a49-8994-222075a1e167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:24:57.689056 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 573/1119] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:24:57 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:24:57.702313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6378-072c-4183-b1f3-4501897fbc21 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:57.702605 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6378-072c-4183-b1f3-4501897fbc21 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:57.702883 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6378-072c-4183-b1f3-4501897fbc21 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:57.704219 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 547/1120] 10.222.0.82 () {54 vars in 964 bytes} [Fri Aug 19 01:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:24:57.709349 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a97aec-2d8c-4ab7-9913-ec6ac8209970 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:57.709673 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a97aec-2d8c-4ab7-9913-ec6ac8209970 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:57.712149 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a97aec-2d8c-4ab7-9913-ec6ac8209970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:57.728688 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-10a97aec-2d8c-4ab7-9913-ec6ac8209970 None None] MFA Rules not processed for user `1d273bdfc2d147ba9392544f9e8831a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:24:57.729906 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-10a97aec-2d8c-4ab7-9913-ec6ac8209970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:24:57.773472 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:24:57.780726 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 574/1121] 10.222.0.82 () {58 vars in 1061 bytes} [Fri Aug 19 01:24:57 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:24:57.788484 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c6378-072c-4183-b1f3-4501897fbc21 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:24:57.799846 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c6378-072c-4183-b1f3-4501897fbc21 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:24:57.803381 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3257316-2b8a-4867-9c23-aa7d30dd741b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d273bdfc2d147ba9392544f9e8831a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:24:57.803921 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3257316-2b8a-4867-9c23-aa7d30dd741b service cinder] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:57.804213 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3257316-2b8a-4867-9c23-aa7d30dd741b service cinder] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:57.804477 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3257316-2b8a-4867-9c23-aa7d30dd741b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:57.813271 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3257316-2b8a-4867-9c23-aa7d30dd741b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:24:57.814718 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3257316-2b8a-4867-9c23-aa7d30dd741b service cinder] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:24:57.823302 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 548/1122] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:24:57 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:24:57.862838 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75582fc3-9831-4682-8f40-bdadf599071c None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:57.863129 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75582fc3-9831-4682-8f40-bdadf599071c None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:57.863410 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75582fc3-9831-4682-8f40-bdadf599071c None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:57.864648 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 575/1123] 10.222.0.82 () {52 vars in 830 bytes} [Fri Aug 19 01:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:24:57.868113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3257316-2b8a-4867-9c23-aa7d30dd741b service cinder] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:24:57.928896 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3257316-2b8a-4867-9c23-aa7d30dd741b service cinder] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:24:57.933349 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce81e-99d6-4c24-8205-d1af469bb449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:24:57.933959 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce81e-99d6-4c24-8205-d1af469bb449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:57.934234 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce81e-99d6-4c24-8205-d1af469bb449 admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:57.934503 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce81e-99d6-4c24-8205-d1af469bb449 admin admin] PATH_INFO: `/v3/users/390edf1f58654955a6c3e85ae8c101d3` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:57.935814 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce81e-99d6-4c24-8205-d1af469bb449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=390edf1f58654955a6c3e85ae8c101d3)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:24:57.936827 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: WARNING py.warnings [None req-4abce81e-99d6-4c24-8205-d1af469bb449 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:24:57.936827 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: warnings.warn(msg) Aug 19 01:24:57.936827 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: Aug 19 01:24:57.938057 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce81e-99d6-4c24-8205-d1af469bb449 admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:24:58.148962 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-4abce81e-99d6-4c24-8205-d1af469bb449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '390edf1f58654955a6c3e85ae8c101d3'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:24:58.173280 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-4abce81e-99d6-4c24-8205-d1af469bb449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '390edf1f58654955a6c3e85ae8c101d3'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:24:58.187745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-4abce81e-99d6-4c24-8205-d1af469bb449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '390edf1f58654955a6c3e85ae8c101d3'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:24:58.188528 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-4abce81e-99d6-4c24-8205-d1af469bb449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '390edf1f58654955a6c3e85ae8c101d3'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:24:58.189161 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-4abce81e-99d6-4c24-8205-d1af469bb449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '390edf1f58654955a6c3e85ae8c101d3'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:24:58.193109 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:24:58.290555 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 549/1124] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Aug 19 01:24:57 2022] DELETE /identity/v3/users/390edf1f58654955a6c3e85ae8c101d3 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:24:58.295175 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9f2b-c70d-42ec-b968-694b887c08f2 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:58.295678 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9f2b-c70d-42ec-b968-694b887c08f2 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:58.295786 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9f2b-c70d-42ec-b968-694b887c08f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:58.315665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-e3fc9f2b-c70d-42ec-b968-694b887c08f2 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:24:58.317525 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-e3fc9f2b-c70d-42ec-b968-694b887c08f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:24:58.377559 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 576/1125] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:24:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:24:58.389494 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce81e-99d6-4c24-8205-d1af469bb449 admin admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:24:58.390977 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-4abce81e-99d6-4c24-8205-d1af469bb449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:24:58.460645 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce81e-99d6-4c24-8205-d1af469bb449 admin admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:24:58.464165 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e421b-f6bf-4911-948c-863bd150158a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:24:58.464767 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e421b-f6bf-4911-948c-863bd150158a service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:58.465074 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e421b-f6bf-4911-948c-863bd150158a service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:58.465346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e421b-f6bf-4911-948c-863bd150158a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:58.474836 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e421b-f6bf-4911-948c-863bd150158a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:24:58.476280 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e421b-f6bf-4911-948c-863bd150158a service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:24:58.485779 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 550/1126] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:24:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:24:58.970582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc9f2b-c70d-42ec-b968-694b887c08f2 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:24:58.972074 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-e3fc9f2b-c70d-42ec-b968-694b887c08f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:24:58.984731 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc9f2b-c70d-42ec-b968-694b887c08f2 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:24:58.989440 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa9532-960a-4f78-b5ef-e78dca76c8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:24:58.990119 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa9532-960a-4f78-b5ef-e78dca76c8ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:24:58.990407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa9532-960a-4f78-b5ef-e78dca76c8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:24:58.991093 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa9532-960a-4f78-b5ef-e78dca76c8ef admin admin] PATH_INFO: `/v3/projects/5b4a465116734dfb8626a537a7f47140` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:24:58.992528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa9532-960a-4f78-b5ef-e78dca76c8ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b4a465116734dfb8626a537a7f47140)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:24:58.993905 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: WARNING py.warnings [None req-dbfa9532-960a-4f78-b5ef-e78dca76c8ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:24:58.993905 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: warnings.warn(msg) Aug 19 01:24:58.993905 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: Aug 19 01:24:58.994808 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa9532-960a-4f78-b5ef-e78dca76c8ef admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:24:59.112833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-dbfa9532-960a-4f78-b5ef-e78dca76c8ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b4a465116734dfb8626a537a7f47140', 'request_id': 'req-dbfa9532-960a-4f78-b5ef-e78dca76c8ef'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:24:59.126499 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-dbfa9532-960a-4f78-b5ef-e78dca76c8ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b4a465116734dfb8626a537a7f47140', 'request_id': 'req-dbfa9532-960a-4f78-b5ef-e78dca76c8ef'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:24:59.132916 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-dbfa9532-960a-4f78-b5ef-e78dca76c8ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b4a465116734dfb8626a537a7f47140', 'request_id': 'req-dbfa9532-960a-4f78-b5ef-e78dca76c8ef'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:24:59.231312 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-dbfa9532-960a-4f78-b5ef-e78dca76c8ef admin admin] The token cache is being invalidate because project 5b4a465116734dfb8626a537a7f47140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88726) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 01:24:59.231538 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-dbfa9532-960a-4f78-b5ef-e78dca76c8ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:24:59.233283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-dbfa9532-960a-4f78-b5ef-e78dca76c8ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:24:59.234801 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 577/1127] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Aug 19 01:24:58 2022] DELETE /identity/v3/projects/5b4a465116734dfb8626a537a7f47140 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:25:08.481564 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:DELETE=1,keystone:SELECT=33 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:25:09.227656 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:26:23.230851 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303694ec-96f5-481b-a87b-4d0d3f36b049 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:23.231456 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303694ec-96f5-481b-a87b-4d0d3f36b049 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:23.231456 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303694ec-96f5-481b-a87b-4d0d3f36b049 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:23.232744 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 551/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 01:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:26:23.237635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dbc6e-4312-4b7f-9aca-c75a36260ad0 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:23.238090 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dbc6e-4312-4b7f-9aca-c75a36260ad0 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:23.238201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dbc6e-4312-4b7f-9aca-c75a36260ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:23.258381 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-8b3dbc6e-4312-4b7f-9aca-c75a36260ad0 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:26:23.259581 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-8b3dbc6e-4312-4b7f-9aca-c75a36260ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:26:23.319194 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 578/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 01:26:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:26:23.476811 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303694ec-96f5-481b-a87b-4d0d3f36b049 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:26:23.478531 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-303694ec-96f5-481b-a87b-4d0d3f36b049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:26:23.551189 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303694ec-96f5-481b-a87b-4d0d3f36b049 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:26:23.556077 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7122953-9e28-484e-ad88-fc709fee18eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:26:23.556683 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7122953-9e28-484e-ad88-fc709fee18eb service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:23.556989 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7122953-9e28-484e-ad88-fc709fee18eb service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:23.557263 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7122953-9e28-484e-ad88-fc709fee18eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:23.566023 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7122953-9e28-484e-ad88-fc709fee18eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:26:23.567639 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7122953-9e28-484e-ad88-fc709fee18eb service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:26:23.577054 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 552/1130] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:26:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:26:24.419715 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc515b3f-30cd-46e9-bd4a-f225a509adaf None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:24.420347 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc515b3f-30cd-46e9-bd4a-f225a509adaf None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:24.420347 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc515b3f-30cd-46e9-bd4a-f225a509adaf None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:24.421705 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 579/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 01:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:26:24.427406 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80e513-cb79-4b5c-bc3d-a51e1cc5317b None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:24.427951 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80e513-cb79-4b5c-bc3d-a51e1cc5317b None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:24.427951 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80e513-cb79-4b5c-bc3d-a51e1cc5317b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:24.448189 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-7e80e513-cb79-4b5c-bc3d-a51e1cc5317b None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:26:24.449433 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-7e80e513-cb79-4b5c-bc3d-a51e1cc5317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:26:24.457863 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 553/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 01:26:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:26:24.618478 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc515b3f-30cd-46e9-bd4a-f225a509adaf None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:26:24.633005 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc515b3f-30cd-46e9-bd4a-f225a509adaf None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:26:24.637919 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039a96c-86b7-4936-a22c-143c6327dc5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:26:24.638462 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039a96c-86b7-4936-a22c-143c6327dc5c service nova] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:24.643331 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039a96c-86b7-4936-a22c-143c6327dc5c service nova] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:24.643331 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039a96c-86b7-4936-a22c-143c6327dc5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:24.648006 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039a96c-86b7-4936-a22c-143c6327dc5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:26:24.649644 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039a96c-86b7-4936-a22c-143c6327dc5c service nova] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:26:24.659802 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 580/1133] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:26:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:26:29.713956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce589f-541d-4552-82a8-93c6c7e5cd58 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:29.714553 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce589f-541d-4552-82a8-93c6c7e5cd58 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:29.714553 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce589f-541d-4552-82a8-93c6c7e5cd58 None None] PATH_INFO: `/v3` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:29.715761 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 554/1134] 10.222.0.58 () {54 vars in 925 bytes} [Fri Aug 19 01:26:29 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 01:26:29.722037 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857b244-c6a6-4cac-a154-722ef8b2aab6 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:29.722477 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857b244-c6a6-4cac-a154-722ef8b2aab6 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:29.722595 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857b244-c6a6-4cac-a154-722ef8b2aab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:29.756023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-1857b244-c6a6-4cac-a154-722ef8b2aab6 None None] MFA Rules not processed for user `246b63ecc51347f08daad24d75e3de27`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:26:29.757929 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-1857b244-c6a6-4cac-a154-722ef8b2aab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:26:29.832002 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 581/1135] 10.222.0.58 () {58 vars in 1015 bytes} [Fri Aug 19 01:26:29 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:26:34.201791 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54052020-8eab-442e-a29d-342d81df0ad2 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:34.202339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54052020-8eab-442e-a29d-342d81df0ad2 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:34.202339 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54052020-8eab-442e-a29d-342d81df0ad2 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:34.203652 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 555/1136] 10.222.0.82 () {54 vars in 961 bytes} [Fri Aug 19 01:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:26:34.208616 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156df0b-01e2-4369-a3da-5d8506a1a9c7 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:34.209083 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156df0b-01e2-4369-a3da-5d8506a1a9c7 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:34.209178 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156df0b-01e2-4369-a3da-5d8506a1a9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:34.228594 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-1156df0b-01e2-4369-a3da-5d8506a1a9c7 None None] MFA Rules not processed for user `246b63ecc51347f08daad24d75e3de27`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:26:34.229821 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-1156df0b-01e2-4369-a3da-5d8506a1a9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:26:34.238775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 582/1137] 10.222.0.82 () {58 vars in 1058 bytes} [Fri Aug 19 01:26:34 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:26:34.245857 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54052020-8eab-442e-a29d-342d81df0ad2 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:26:34.260024 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54052020-8eab-442e-a29d-342d81df0ad2 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:26:34.264922 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aacd31-c177-496a-8e2a-756bb280fe2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '246b63ecc51347f08daad24d75e3de27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:26:34.265534 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aacd31-c177-496a-8e2a-756bb280fe2e service placement] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:34.265812 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aacd31-c177-496a-8e2a-756bb280fe2e service placement] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:34.266082 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aacd31-c177-496a-8e2a-756bb280fe2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:34.274373 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aacd31-c177-496a-8e2a-756bb280fe2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:26:34.275957 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aacd31-c177-496a-8e2a-756bb280fe2e service placement] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:26:34.285819 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 556/1138] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:26:34 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:26:35.907095 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f1079-58c0-495d-b607-3818542d36d5 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:35.907959 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f1079-58c0-495d-b607-3818542d36d5 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:35.907959 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f1079-58c0-495d-b607-3818542d36d5 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:35.909033 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 583/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 01:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:26:35.913706 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a89ea7-9c14-4cfa-bac9-64138284b113 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:35.914088 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a89ea7-9c14-4cfa-bac9-64138284b113 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:35.914259 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a89ea7-9c14-4cfa-bac9-64138284b113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:35.933775 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-43a89ea7-9c14-4cfa-bac9-64138284b113 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:26:35.934971 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-43a89ea7-9c14-4cfa-bac9-64138284b113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:26:35.943536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 557/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 01:26:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:26:36.101433 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f1079-58c0-495d-b607-3818542d36d5 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:26:36.115490 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f1079-58c0-495d-b607-3818542d36d5 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:26:36.120302 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521dd1d-0fc8-4b52-8058-c4bdb64f6af2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:26:36.120926 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521dd1d-0fc8-4b52-8058-c4bdb64f6af2 service nova] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:36.121230 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521dd1d-0fc8-4b52-8058-c4bdb64f6af2 service nova] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:36.121567 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521dd1d-0fc8-4b52-8058-c4bdb64f6af2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:36.130137 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521dd1d-0fc8-4b52-8058-c4bdb64f6af2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:26:36.131707 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521dd1d-0fc8-4b52-8058-c4bdb64f6af2 service nova] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:26:36.141513 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 584/1141] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:26:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:26:36.990394 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6154e4-b5f0-474a-9725-686d60ca8f66 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:36.990964 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6154e4-b5f0-474a-9725-686d60ca8f66 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:36.990964 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6154e4-b5f0-474a-9725-686d60ca8f66 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:36.992249 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 558/1142] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 01:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:26:36.997084 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74614e4-a5ed-460f-8c9d-51449430a5b2 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:36.997518 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74614e4-a5ed-460f-8c9d-51449430a5b2 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:36.997625 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74614e4-a5ed-460f-8c9d-51449430a5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:37.017180 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-d74614e4-a5ed-460f-8c9d-51449430a5b2 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:26:37.018375 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-d74614e4-a5ed-460f-8c9d-51449430a5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:26:37.026101 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 585/1143] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 01:26:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:26:37.186956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6154e4-b5f0-474a-9725-686d60ca8f66 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:26:37.200335 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6154e4-b5f0-474a-9725-686d60ca8f66 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:26:37.206134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877a7fb-f04d-4899-bf39-a78b4970f734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:26:37.206720 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877a7fb-f04d-4899-bf39-a78b4970f734 service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:37.206999 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877a7fb-f04d-4899-bf39-a78b4970f734 service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:37.207269 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877a7fb-f04d-4899-bf39-a78b4970f734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:37.215419 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877a7fb-f04d-4899-bf39-a78b4970f734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:26:37.217043 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877a7fb-f04d-4899-bf39-a78b4970f734 service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:26:37.227086 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 559/1144] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:26:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:26:41.431286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d606869-d903-4259-bb0d-03fb14f61e6e None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:41.431867 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d606869-d903-4259-bb0d-03fb14f61e6e None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:41.431867 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d606869-d903-4259-bb0d-03fb14f61e6e None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:41.433176 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 586/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:26:41.438330 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16246a0b-5d8d-4e33-950e-14383f0f03f1 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:41.438803 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16246a0b-5d8d-4e33-950e-14383f0f03f1 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:41.439026 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16246a0b-5d8d-4e33-950e-14383f0f03f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:41.458294 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-16246a0b-5d8d-4e33-950e-14383f0f03f1 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:26:41.465004 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-16246a0b-5d8d-4e33-950e-14383f0f03f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:26:41.473444 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 560/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:26:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:26:41.819782 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d606869-d903-4259-bb0d-03fb14f61e6e None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:26:41.821518 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-2d606869-d903-4259-bb0d-03fb14f61e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:26:41.874875 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=100 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:26:41.880831 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d606869-d903-4259-bb0d-03fb14f61e6e None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:26:41.884670 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae1273-0d8b-4987-b5f6-59cfd61b83d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:26:41.885306 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae1273-0d8b-4987-b5f6-59cfd61b83d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:41.892198 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae1273-0d8b-4987-b5f6-59cfd61b83d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:41.892198 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae1273-0d8b-4987-b5f6-59cfd61b83d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:41.895003 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae1273-0d8b-4987-b5f6-59cfd61b83d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:26:41.896415 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae1273-0d8b-4987-b5f6-59cfd61b83d9 service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:26:41.905485 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 587/1147] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:26:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:26:44.111413 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24813a07-1f2a-4e77-b0c6-2d5713f90f81 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:44.111962 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24813a07-1f2a-4e77-b0c6-2d5713f90f81 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:44.111962 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24813a07-1f2a-4e77-b0c6-2d5713f90f81 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:44.113308 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 561/1148] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:26:44.118376 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6c01c-222f-492d-96e3-aabe8cb89aef None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:44.118779 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6c01c-222f-492d-96e3-aabe8cb89aef None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:44.118950 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6c01c-222f-492d-96e3-aabe8cb89aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:44.138847 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-cbf6c01c-222f-492d-96e3-aabe8cb89aef None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:26:44.140089 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-cbf6c01c-222f-492d-96e3-aabe8cb89aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:26:44.148746 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 588/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:26:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:26:44.498825 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24813a07-1f2a-4e77-b0c6-2d5713f90f81 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:26:44.510640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24813a07-1f2a-4e77-b0c6-2d5713f90f81 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:26:44.514074 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400034ec-c129-447c-b4c3-2b44198d98db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:26:44.514650 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400034ec-c129-447c-b4c3-2b44198d98db service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:44.514923 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400034ec-c129-447c-b4c3-2b44198d98db service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:44.515186 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400034ec-c129-447c-b4c3-2b44198d98db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:44.523865 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400034ec-c129-447c-b4c3-2b44198d98db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:26:44.525334 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400034ec-c129-447c-b4c3-2b44198d98db service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:26:44.535295 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 562/1150] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:26:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:26:48.206578 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7af6ce-6c1a-4d88-90d6-157b54978a76 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:48.207129 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7af6ce-6c1a-4d88-90d6-157b54978a76 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:48.207129 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7af6ce-6c1a-4d88-90d6-157b54978a76 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:48.208459 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 589/1151] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:26:48.213537 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f9ade-ced3-428f-a695-23790012eb0a None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:48.213934 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f9ade-ced3-428f-a695-23790012eb0a None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:48.214079 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f9ade-ced3-428f-a695-23790012eb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:48.233092 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-bf3f9ade-ced3-428f-a695-23790012eb0a None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:26:48.234296 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-bf3f9ade-ced3-428f-a695-23790012eb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:26:48.242093 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 563/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:26:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:26:48.834711 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7af6ce-6c1a-4d88-90d6-157b54978a76 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:26:48.836354 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-ee7af6ce-6c1a-4d88-90d6-157b54978a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:26:48.893143 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7af6ce-6c1a-4d88-90d6-157b54978a76 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:26:48.896565 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8285526-acc6-4939-97f1-23cb31fa418c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d273bdfc2d147ba9392544f9e8831a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:26:48.897211 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8285526-acc6-4939-97f1-23cb31fa418c service cinder] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:48.897488 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8285526-acc6-4939-97f1-23cb31fa418c service cinder] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:48.897751 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8285526-acc6-4939-97f1-23cb31fa418c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:48.906357 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8285526-acc6-4939-97f1-23cb31fa418c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:26:48.907807 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8285526-acc6-4939-97f1-23cb31fa418c service cinder] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:26:48.916969 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 590/1153] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:26:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:26:51.120424 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee5ab-88aa-4c9b-a47a-17df234ffd88 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:51.121053 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee5ab-88aa-4c9b-a47a-17df234ffd88 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:51.121053 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee5ab-88aa-4c9b-a47a-17df234ffd88 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:51.122422 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 564/1154] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 01:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:26:51.128300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0025dff-4b18-4478-8247-9fdc67b74663 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:51.128739 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0025dff-4b18-4478-8247-9fdc67b74663 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:51.128872 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0025dff-4b18-4478-8247-9fdc67b74663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:51.150054 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-e0025dff-4b18-4478-8247-9fdc67b74663 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:26:51.151275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-e0025dff-4b18-4478-8247-9fdc67b74663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:26:51.159030 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 591/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 01:26:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:26:51.736649 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cee5ab-88aa-4c9b-a47a-17df234ffd88 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:26:51.738418 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-02cee5ab-88aa-4c9b-a47a-17df234ffd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:26:51.746164 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=63 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:26:51.752369 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cee5ab-88aa-4c9b-a47a-17df234ffd88 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:26:51.755917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa84ecb-8354-457c-9761-9a9e294ff2a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d273bdfc2d147ba9392544f9e8831a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:26:51.756518 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa84ecb-8354-457c-9761-9a9e294ff2a2 service cinder] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:26:51.756800 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa84ecb-8354-457c-9761-9a9e294ff2a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:26:51.757103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa84ecb-8354-457c-9761-9a9e294ff2a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:26:51.766703 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa84ecb-8354-457c-9761-9a9e294ff2a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:26:51.768441 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa84ecb-8354-457c-9761-9a9e294ff2a2 service cinder] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:26:51.778516 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 565/1156] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:26:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:27:01.145273 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=37 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:27:01.775137 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=5 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:28:05.585223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5b38f-5cf7-4b0e-9e07-4fe6b281238c None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:05.585223 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5b38f-5cf7-4b0e-9e07-4fe6b281238c None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:05.588221 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5b38f-5cf7-4b0e-9e07-4fe6b281238c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:05.598825 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c4d1d-8e75-419f-8256-b4cacea3a6d9 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:05.599382 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c4d1d-8e75-419f-8256-b4cacea3a6d9 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:05.599382 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c4d1d-8e75-419f-8256-b4cacea3a6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:05.608401 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-aee5b38f-5cf7-4b0e-9e07-4fe6b281238c None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:05.609701 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-aee5b38f-5cf7-4b0e-9e07-4fe6b281238c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:05.621723 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-1b8c4d1d-8e75-419f-8256-b4cacea3a6d9 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:05.623038 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-1b8c4d1d-8e75-419f-8256-b4cacea3a6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:05.624031 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 592/1157] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:28:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:28:05.633876 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95f334-68b7-4904-8a1f-36a82d541ed5 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:05.634174 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95f334-68b7-4904-8a1f-36a82d541ed5 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:05.634483 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95f334-68b7-4904-8a1f-36a82d541ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:05.639656 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 566/1158] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:28:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:28:05.648223 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd81a01-1605-4296-bcd0-f825fec45252 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:05.648510 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd81a01-1605-4296-bcd0-f825fec45252 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:05.648784 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd81a01-1605-4296-bcd0-f825fec45252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:05.659826 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-5c95f334-68b7-4904-8a1f-36a82d541ed5 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:05.664713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-5c95f334-68b7-4904-8a1f-36a82d541ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:05.669857 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 593/1159] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:28:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:28:05.670008 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-5fd81a01-1605-4296-bcd0-f825fec45252 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:05.671172 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-5fd81a01-1605-4296-bcd0-f825fec45252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:05.674572 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95f334-68b7-4904-8a1f-36a82d541ed5 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:05.679520 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 567/1160] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:28:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:28:05.684311 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95f334-68b7-4904-8a1f-36a82d541ed5 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:05.686225 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd81a01-1605-4296-bcd0-f825fec45252 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:05.689040 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd9523-afb1-4da4-9d59-54e1ddac0e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:05.689633 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd9523-afb1-4da4-9d59-54e1ddac0e60 admin admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:05.689910 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd9523-afb1-4da4-9d59-54e1ddac0e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:05.690180 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd9523-afb1-4da4-9d59-54e1ddac0e60 admin admin] PATH_INFO: `/v3/domains` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:05.690819 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd9523-afb1-4da4-9d59-54e1ddac0e60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88726) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:28:05.691145 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd9523-afb1-4da4-9d59-54e1ddac0e60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:05.692736 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd9523-afb1-4da4-9d59-54e1ddac0e60 admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:05.696079 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd81a01-1605-4296-bcd0-f825fec45252 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:05.700703 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610ed96-3492-4761-838f-0fe77b25c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:05.701325 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610ed96-3492-4761-838f-0fe77b25c37b admin admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:05.701604 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610ed96-3492-4761-838f-0fe77b25c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:05.701876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610ed96-3492-4761-838f-0fe77b25c37b admin admin] PATH_INFO: `/v3/domains` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:05.702513 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610ed96-3492-4761-838f-0fe77b25c37b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88725) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 01:28:05.702813 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610ed96-3492-4761-838f-0fe77b25c37b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:05.703829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: WARNING py.warnings [None req-e610ed96-3492-4761-838f-0fe77b25c37b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:28:05.703829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: warnings.warn(msg) Aug 19 01:28:05.703829 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: Aug 19 01:28:05.704711 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610ed96-3492-4761-838f-0fe77b25c37b admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:05.706049 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 594/1161] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Aug 19 01:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:28:05.714571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd9523-afb1-4da4-9d59-54e1ddac0e60 admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:05.720886 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 568/1162] 10.222.0.82 () {58 vars in 1153 bytes} [Fri Aug 19 01:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 01:28:05.725383 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd9523-afb1-4da4-9d59-54e1ddac0e60 admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:05.728666 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610ed96-3492-4761-838f-0fe77b25c37b admin admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:05.730193 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c23ddc-f31c-42e6-ae8b-bdd92f4e433c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:05.730801 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c23ddc-f31c-42e6-ae8b-bdd92f4e433c admin admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:05.731077 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c23ddc-f31c-42e6-ae8b-bdd92f4e433c admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:05.731346 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c23ddc-f31c-42e6-ae8b-bdd92f4e433c admin admin] PATH_INFO: `/v3/projects` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:05.731980 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c23ddc-f31c-42e6-ae8b-bdd92f4e433c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:05.733027 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: WARNING py.warnings [None req-c5c23ddc-f31c-42e6-ae8b-bdd92f4e433c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:28:05.733027 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: warnings.warn(msg) Aug 19 01:28:05.733027 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: Aug 19 01:28:05.734210 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c23ddc-f31c-42e6-ae8b-bdd92f4e433c admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:05.738731 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610ed96-3492-4761-838f-0fe77b25c37b admin admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:05.743363 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576e8d6-0e22-45e3-8a73-41abd23b0d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:05.743958 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576e8d6-0e22-45e3-8a73-41abd23b0d09 admin admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:05.744240 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576e8d6-0e22-45e3-8a73-41abd23b0d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:05.744510 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576e8d6-0e22-45e3-8a73-41abd23b0d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:05.745143 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576e8d6-0e22-45e3-8a73-41abd23b0d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:05.747046 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576e8d6-0e22-45e3-8a73-41abd23b0d09 admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:05.824921 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 595/1163] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Aug 19 01:28:05 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:28:05.829162 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c23ddc-f31c-42e6-ae8b-bdd92f4e433c admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:05.845951 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 569/1164] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Aug 19 01:28:05 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:28:05.851582 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576e8d6-0e22-45e3-8a73-41abd23b0d09 admin admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:05.897967 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c23ddc-f31c-42e6-ae8b-bdd92f4e433c admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:05.913787 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576e8d6-0e22-45e3-8a73-41abd23b0d09 admin admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:05.919726 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445718d-b543-4693-b157-70521d3476dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:05.920330 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445718d-b543-4693-b157-70521d3476dd admin admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:05.920608 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445718d-b543-4693-b157-70521d3476dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:05.920932 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445718d-b543-4693-b157-70521d3476dd admin admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:05.921549 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445718d-b543-4693-b157-70521d3476dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:05.922610 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: WARNING py.warnings [None req-5445718d-b543-4693-b157-70521d3476dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:28:05.922610 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: warnings.warn(msg) Aug 19 01:28:05.922610 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: Aug 19 01:28:05.923800 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445718d-b543-4693-b157-70521d3476dd admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:05.953717 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf64db-e872-4b2b-98f5-fe80eb189b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:05.954332 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf64db-e872-4b2b-98f5-fe80eb189b8c admin admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:05.954614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf64db-e872-4b2b-98f5-fe80eb189b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:05.954887 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf64db-e872-4b2b-98f5-fe80eb189b8c admin admin] PATH_INFO: `/v3/users` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:05.955500 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf64db-e872-4b2b-98f5-fe80eb189b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:05.957582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf64db-e872-4b2b-98f5-fe80eb189b8c admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:06.011072 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 570/1165] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Aug 19 01:28:05 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:28:06.015438 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445718d-b543-4693-b157-70521d3476dd admin admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:06.025876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445718d-b543-4693-b157-70521d3476dd admin admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:06.030456 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a39ed6-49d1-4241-9fc0-e84dcb607538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:06.031025 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a39ed6-49d1-4241-9fc0-e84dcb607538 admin admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:06.031298 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a39ed6-49d1-4241-9fc0-e84dcb607538 admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:06.031639 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a39ed6-49d1-4241-9fc0-e84dcb607538 admin admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:06.032324 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a39ed6-49d1-4241-9fc0-e84dcb607538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:06.033948 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a39ed6-49d1-4241-9fc0-e84dcb607538 admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:06.040933 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 596/1166] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Aug 19 01:28:05 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:28:06.045846 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf64db-e872-4b2b-98f5-fe80eb189b8c admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:06.049359 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 571/1167] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Aug 19 01:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 01:28:06.050301 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a39ed6-49d1-4241-9fc0-e84dcb607538 admin admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:06.056797 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf64db-e872-4b2b-98f5-fe80eb189b8c admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:06.061937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92654577-f8c7-4d99-9201-461a28a7e9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:06.062363 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a39ed6-49d1-4241-9fc0-e84dcb607538 admin admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:06.062548 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92654577-f8c7-4d99-9201-461a28a7e9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:06.062830 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92654577-f8c7-4d99-9201-461a28a7e9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:06.063102 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92654577-f8c7-4d99-9201-461a28a7e9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:06.063746 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92654577-f8c7-4d99-9201-461a28a7e9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:06.065520 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92654577-f8c7-4d99-9201-461a28a7e9e6 admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:06.067551 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d258a69-7b29-4c98-b96e-2db10d802dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:06.068151 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d258a69-7b29-4c98-b96e-2db10d802dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:06.068432 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d258a69-7b29-4c98-b96e-2db10d802dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:06.068705 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d258a69-7b29-4c98-b96e-2db10d802dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:06.069656 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d258a69-7b29-4c98-b96e-2db10d802dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:06.071252 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d258a69-7b29-4c98-b96e-2db10d802dd6 admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:06.077280 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 597/1168] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Aug 19 01:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 01:28:06.080148 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92654577-f8c7-4d99-9201-461a28a7e9e6 admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:06.085015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 572/1169] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Aug 19 01:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 01:28:06.085925 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d258a69-7b29-4c98-b96e-2db10d802dd6 admin admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:06.093323 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92654577-f8c7-4d99-9201-461a28a7e9e6 admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:06.095754 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d258a69-7b29-4c98-b96e-2db10d802dd6 admin admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:06.098330 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6324f-3619-491b-a60f-7c5591571afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:06.099000 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6324f-3619-491b-a60f-7c5591571afb admin admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:06.099345 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6324f-3619-491b-a60f-7c5591571afb admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:06.099689 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6324f-3619-491b-a60f-7c5591571afb admin admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:06.101185 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6324f-3619-491b-a60f-7c5591571afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:06.101433 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2e161-688b-4a9b-af68-8a7e119d3869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:06.106072 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2e161-688b-4a9b-af68-8a7e119d3869 admin admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:06.106072 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2e161-688b-4a9b-af68-8a7e119d3869 admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:06.106072 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2e161-688b-4a9b-af68-8a7e119d3869 admin admin] PATH_INFO: `/v3/projects/f9a1cb2ce89a47a0b3ec7c55ce9d9b25/users/99695a3ad43943dcbb8d32b57abafce7/roles/f8c07e35d799437cbb53316acc2fc030` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:06.106365 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6324f-3619-491b-a60f-7c5591571afb admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:06.113694 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 598/1170] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Aug 19 01:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 01:28:06.117792 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6324f-3619-491b-a60f-7c5591571afb admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:06.119174 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2e161-688b-4a9b-af68-8a7e119d3869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a1cb2ce89a47a0b3ec7c55ce9d9b25, user_id=99695a3ad43943dcbb8d32b57abafce7, role_id=f8c07e35d799437cbb53316acc2fc030)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:06.121913 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2e161-688b-4a9b-af68-8a7e119d3869 admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:06.127248 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6324f-3619-491b-a60f-7c5591571afb admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:06.132018 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb4a9f-d59e-42a7-88e6-747d2d444300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:06.138083 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb4a9f-d59e-42a7-88e6-747d2d444300 admin admin] REQUEST_METHOD: `PUT` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:06.138083 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb4a9f-d59e-42a7-88e6-747d2d444300 admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:06.138083 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb4a9f-d59e-42a7-88e6-747d2d444300 admin admin] PATH_INFO: `/v3/projects/75dc2efddbec4981b5037bb428068c23/users/8405945d089b4d319d325c1b9ab0f857/roles/f8c07e35d799437cbb53316acc2fc030` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:06.148204 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb4a9f-d59e-42a7-88e6-747d2d444300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75dc2efddbec4981b5037bb428068c23, user_id=8405945d089b4d319d325c1b9ab0f857, role_id=f8c07e35d799437cbb53316acc2fc030)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:06.149349 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: WARNING py.warnings [None req-6ffb4a9f-d59e-42a7-88e6-747d2d444300 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:28:06.149349 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: warnings.warn(msg) Aug 19 01:28:06.149349 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: Aug 19 01:28:06.151283 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb4a9f-d59e-42a7-88e6-747d2d444300 admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:06.189483 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 573/1171] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Aug 19 01:28:06 2022] PUT /identity/v3/projects/f9a1cb2ce89a47a0b3ec7c55ce9d9b25/users/99695a3ad43943dcbb8d32b57abafce7/roles/f8c07e35d799437cbb53316acc2fc030 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 01:28:06.194741 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736aeba-5137-4271-83af-7b18e7001e3b None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:06.195054 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736aeba-5137-4271-83af-7b18e7001e3b None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:06.195330 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736aeba-5137-4271-83af-7b18e7001e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:06.214645 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-b736aeba-5137-4271-83af-7b18e7001e3b None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:06.215859 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-b736aeba-5137-4271-83af-7b18e7001e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:06.217881 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 599/1172] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Aug 19 01:28:06 2022] PUT /identity/v3/projects/75dc2efddbec4981b5037bb428068c23/users/8405945d089b4d319d325c1b9ab0f857/roles/f8c07e35d799437cbb53316acc2fc030 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 01:28:06.227567 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7a7e-79b4-4c5d-a8a6-f49f6724ec94 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:06.227854 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7a7e-79b4-4c5d-a8a6-f49f6724ec94 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:06.228128 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7a7e-79b4-4c5d-a8a6-f49f6724ec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:06.235396 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:28:06.248040 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-69da7a7e-79b4-4c5d-a8a6-f49f6724ec94 None None] MFA Rules not processed for user `93e416b080ca43b493d7d04aa867adf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:06.250628 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-69da7a7e-79b4-4c5d-a8a6-f49f6724ec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:06.265265 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:28:06.276635 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 574/1173] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:28:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:28:06.287242 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736aeba-5137-4271-83af-7b18e7001e3b None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:06.313205 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 600/1174] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:28:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:28:06.323845 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da7a7e-79b4-4c5d-a8a6-f49f6724ec94 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:06.345430 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736aeba-5137-4271-83af-7b18e7001e3b None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:06.348945 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c50f4b-a4e3-4496-9974-37a5a1522ebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:06.349562 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c50f4b-a4e3-4496-9974-37a5a1522ebe service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:06.349837 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c50f4b-a4e3-4496-9974-37a5a1522ebe service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:06.350112 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c50f4b-a4e3-4496-9974-37a5a1522ebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:06.360677 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c50f4b-a4e3-4496-9974-37a5a1522ebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:06.362167 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c50f4b-a4e3-4496-9974-37a5a1522ebe service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:06.372679 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 575/1175] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:28:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 01:28:06.378894 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da7a7e-79b4-4c5d-a8a6-f49f6724ec94 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:06.383181 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42136f0-5c85-480b-8650-e6e91d36f696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:06.383790 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42136f0-5c85-480b-8650-e6e91d36f696 service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:06.384070 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42136f0-5c85-480b-8650-e6e91d36f696 service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:06.384345 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42136f0-5c85-480b-8650-e6e91d36f696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:06.393690 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42136f0-5c85-480b-8650-e6e91d36f696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:06.395127 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42136f0-5c85-480b-8650-e6e91d36f696 service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:06.405266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 601/1176] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:28:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 01:28:13.458456 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706eed6-7125-4f85-ae5a-18809ca1d742 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:13.459022 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706eed6-7125-4f85-ae5a-18809ca1d742 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:13.459490 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706eed6-7125-4f85-ae5a-18809ca1d742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:13.498991 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-7706eed6-7125-4f85-ae5a-18809ca1d742 None None] MFA Rules not processed for user `8405945d089b4d319d325c1b9ab0f857`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:13.500401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-7706eed6-7125-4f85-ae5a-18809ca1d742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:13.601520 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 576/1177] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:28:13 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:28:13.602781 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42136f0-5c85-480b-8650-e6e91d36f696 service neutron] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:13.612807 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42136f0-5c85-480b-8650-e6e91d36f696 service neutron] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:13.619474 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e832df1-2500-4ebf-9498-83b69c462adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:13.620108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e832df1-2500-4ebf-9498-83b69c462adc admin admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:13.620390 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e832df1-2500-4ebf-9498-83b69c462adc admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:13.620665 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e832df1-2500-4ebf-9498-83b69c462adc admin admin] PATH_INFO: `/v3/projects` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:13.621358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e832df1-2500-4ebf-9498-83b69c462adc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:13.623327 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e832df1-2500-4ebf-9498-83b69c462adc admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:13.743724 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 602/1178] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Aug 19 01:28:13 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:28:13.745032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706eed6-7125-4f85-ae5a-18809ca1d742 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:13.756461 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706eed6-7125-4f85-ae5a-18809ca1d742 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:13.835103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c613ce-9218-4fc4-9912-80b6cde34eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:13.835982 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c613ce-9218-4fc4-9912-80b6cde34eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:13.835982 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c613ce-9218-4fc4-9912-80b6cde34eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:13.835982 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c613ce-9218-4fc4-9912-80b6cde34eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:13.835982 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c613ce-9218-4fc4-9912-80b6cde34eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:13.839376 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c613ce-9218-4fc4-9912-80b6cde34eb4 admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:13.933508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 577/1179] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Aug 19 01:28:13 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 01:28:13.937342 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e832df1-2500-4ebf-9498-83b69c462adc admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:13.949518 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e832df1-2500-4ebf-9498-83b69c462adc admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:13.957408 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14afc25-fb02-4d2b-95f5-b4915ccd829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:13.958296 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14afc25-fb02-4d2b-95f5-b4915ccd829c admin admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:13.958734 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14afc25-fb02-4d2b-95f5-b4915ccd829c admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:13.959194 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14afc25-fb02-4d2b-95f5-b4915ccd829c admin admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:13.959927 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14afc25-fb02-4d2b-95f5-b4915ccd829c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:13.962395 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14afc25-fb02-4d2b-95f5-b4915ccd829c admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:13.973318 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 603/1180] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Aug 19 01:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:28:13.977638 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c613ce-9218-4fc4-9912-80b6cde34eb4 admin admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:13.988373 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c613ce-9218-4fc4-9912-80b6cde34eb4 admin admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:13.999090 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0626f6-c722-45ba-a82c-8cb98954b8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:13.999911 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0626f6-c722-45ba-a82c-8cb98954b8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:14.000265 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0626f6-c722-45ba-a82c-8cb98954b8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:14.000611 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0626f6-c722-45ba-a82c-8cb98954b8bc admin admin] PATH_INFO: `/v3/projects/f024157151114ffaade10e14abbba8c4/users/cbf9c320e576418d9c932bcd895abe5c/roles/fda5389edef24d6baac46d87242d285b` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:14.026895 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0626f6-c722-45ba-a82c-8cb98954b8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f024157151114ffaade10e14abbba8c4, user_id=cbf9c320e576418d9c932bcd895abe5c, role_id=fda5389edef24d6baac46d87242d285b)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:14.030327 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0626f6-c722-45ba-a82c-8cb98954b8bc admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:14.034486 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:28:14.208441 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 578/1181] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Aug 19 01:28:13 2022] PUT /identity/v3/projects/f024157151114ffaade10e14abbba8c4/users/cbf9c320e576418d9c932bcd895abe5c/roles/fda5389edef24d6baac46d87242d285b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:28:14.212372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14afc25-fb02-4d2b-95f5-b4915ccd829c admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:14.230367 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14afc25-fb02-4d2b-95f5-b4915ccd829c admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:14.329458 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1724c-017b-42c8-9ce2-7d3515ebb820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:14.330092 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1724c-017b-42c8-9ce2-7d3515ebb820 admin admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:14.330374 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1724c-017b-42c8-9ce2-7d3515ebb820 admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:14.330645 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1724c-017b-42c8-9ce2-7d3515ebb820 admin admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:14.331451 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1724c-017b-42c8-9ce2-7d3515ebb820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:14.333762 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1724c-017b-42c8-9ce2-7d3515ebb820 admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:14.344621 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db892d2-d49c-4178-94f8-5e0faf8ecc7e None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:14.345092 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db892d2-d49c-4178-94f8-5e0faf8ecc7e None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:14.345470 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db892d2-d49c-4178-94f8-5e0faf8ecc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:14.351150 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 604/1182] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Aug 19 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:28:14.355295 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1724c-017b-42c8-9ce2-7d3515ebb820 admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:14.372207 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1724c-017b-42c8-9ce2-7d3515ebb820 admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:14.378411 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd8181-a4c3-4f5f-9a06-07a1afd29b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:14.379227 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd8181-a4c3-4f5f-9a06-07a1afd29b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:14.379511 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd8181-a4c3-4f5f-9a06-07a1afd29b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:14.379788 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd8181-a4c3-4f5f-9a06-07a1afd29b29 admin admin] PATH_INFO: `/v3/projects/f024157151114ffaade10e14abbba8c4/users/cbf9c320e576418d9c932bcd895abe5c/roles/fda5389edef24d6baac46d87242d285b` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:14.382789 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd8181-a4c3-4f5f-9a06-07a1afd29b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f024157151114ffaade10e14abbba8c4, user_id=cbf9c320e576418d9c932bcd895abe5c, role_id=fda5389edef24d6baac46d87242d285b)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:14.387157 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd8181-a4c3-4f5f-9a06-07a1afd29b29 admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:14.393158 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:28:14.403030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-8db892d2-d49c-4178-94f8-5e0faf8ecc7e None None] MFA Rules not processed for user `99695a3ad43943dcbb8d32b57abafce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:14.406607 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-8db892d2-d49c-4178-94f8-5e0faf8ecc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:14.414262 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 605/1183] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Aug 19 01:28:14 2022] PUT /identity/v3/projects/f024157151114ffaade10e14abbba8c4/users/cbf9c320e576418d9c932bcd895abe5c/roles/fda5389edef24d6baac46d87242d285b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 01:28:14.499637 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 579/1184] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:28:14 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:28:14.504108 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd8181-a4c3-4f5f-9a06-07a1afd29b29 admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:14.575889 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd8181-a4c3-4f5f-9a06-07a1afd29b29 admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:14.580714 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4f153-1b32-4613-9141-cea7ebc6ddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:14.581314 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4f153-1b32-4613-9141-cea7ebc6ddaa admin admin] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:14.581623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4f153-1b32-4613-9141-cea7ebc6ddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:14.581962 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4f153-1b32-4613-9141-cea7ebc6ddaa admin admin] PATH_INFO: `/v3/projects` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:14.582522 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4f153-1b32-4613-9141-cea7ebc6ddaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:14.584440 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4f153-1b32-4613-9141-cea7ebc6ddaa admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:14.666456 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 606/1185] 10.222.0.82 () {60 vars in 1153 bytes} [Fri Aug 19 01:28:14 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:28:14.670511 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db892d2-d49c-4178-94f8-5e0faf8ecc7e None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:14.686897 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db892d2-d49c-4178-94f8-5e0faf8ecc7e None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:14.771343 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55563d-6879-4bc4-9444-e4630706622b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:14.771984 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55563d-6879-4bc4-9444-e4630706622b admin admin] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:14.772292 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55563d-6879-4bc4-9444-e4630706622b admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:14.772566 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55563d-6879-4bc4-9444-e4630706622b admin admin] PATH_INFO: `/v3/users` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:14.773432 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55563d-6879-4bc4-9444-e4630706622b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:14.775636 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55563d-6879-4bc4-9444-e4630706622b admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:14.886944 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 580/1186] 10.222.0.82 () {60 vars in 1144 bytes} [Fri Aug 19 01:28:14 2022] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 01:28:14.888539 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4f153-1b32-4613-9141-cea7ebc6ddaa admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:14.900812 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4f153-1b32-4613-9141-cea7ebc6ddaa admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:14.907330 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf5d1b-2255-451e-9450-2ce377de0b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:14.908400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf5d1b-2255-451e-9450-2ce377de0b3a admin admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:14.908400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf5d1b-2255-451e-9450-2ce377de0b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:14.908602 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf5d1b-2255-451e-9450-2ce377de0b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:14.909263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf5d1b-2255-451e-9450-2ce377de0b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:14.910906 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf5d1b-2255-451e-9450-2ce377de0b3a admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:14.927724 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 607/1187] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Aug 19 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 01:28:14.929771 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55563d-6879-4bc4-9444-e4630706622b admin admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:14.941570 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55563d-6879-4bc4-9444-e4630706622b admin admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:14.946964 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f175-d7f5-43a8-9588-2db0bdfc8890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:14.949239 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f175-d7f5-43a8-9588-2db0bdfc8890 admin admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:14.949239 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f175-d7f5-43a8-9588-2db0bdfc8890 admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:14.949239 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f175-d7f5-43a8-9588-2db0bdfc8890 admin admin] PATH_INFO: `/v3/projects/82c77061f3a744ba833f737a98288bdb/users/d006c20be0374f19a8dcbad86bdf55b7/roles/fda5389edef24d6baac46d87242d285b` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:14.968262 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0f175-d7f5-43a8-9588-2db0bdfc8890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c77061f3a744ba833f737a98288bdb, user_id=d006c20be0374f19a8dcbad86bdf55b7, role_id=fda5389edef24d6baac46d87242d285b)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:14.971095 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0f175-d7f5-43a8-9588-2db0bdfc8890 admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:15.025152 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 581/1188] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Aug 19 01:28:14 2022] PUT /identity/v3/projects/82c77061f3a744ba833f737a98288bdb/users/d006c20be0374f19a8dcbad86bdf55b7/roles/fda5389edef24d6baac46d87242d285b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:28:15.029266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf5d1b-2255-451e-9450-2ce377de0b3a admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:15.041339 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf5d1b-2255-451e-9450-2ce377de0b3a admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:15.115286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003d597-4a0b-4500-95f9-11ee55e7cefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:15.115911 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003d597-4a0b-4500-95f9-11ee55e7cefa admin admin] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:15.116250 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003d597-4a0b-4500-95f9-11ee55e7cefa admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:15.117087 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003d597-4a0b-4500-95f9-11ee55e7cefa admin admin] PATH_INFO: `/v3/roles` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:15.117955 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003d597-4a0b-4500-95f9-11ee55e7cefa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:15.119869 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003d597-4a0b-4500-95f9-11ee55e7cefa admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:15.131571 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 608/1189] 10.222.0.82 () {58 vars in 1122 bytes} [Fri Aug 19 01:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 01:28:15.136483 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f175-d7f5-43a8-9588-2db0bdfc8890 admin admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:15.147703 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f175-d7f5-43a8-9588-2db0bdfc8890 admin admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:15.153437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe88814-e11b-4106-95f0-1cb4a2d04e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:15.154269 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe88814-e11b-4106-95f0-1cb4a2d04e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:15.154639 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe88814-e11b-4106-95f0-1cb4a2d04e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:15.156494 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe88814-e11b-4106-95f0-1cb4a2d04e28 admin admin] PATH_INFO: `/v3/projects/82c77061f3a744ba833f737a98288bdb/users/d006c20be0374f19a8dcbad86bdf55b7/roles/fda5389edef24d6baac46d87242d285b` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:15.158130 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe88814-e11b-4106-95f0-1cb4a2d04e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c77061f3a744ba833f737a98288bdb, user_id=d006c20be0374f19a8dcbad86bdf55b7, role_id=fda5389edef24d6baac46d87242d285b)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:15.161592 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe88814-e11b-4106-95f0-1cb4a2d04e28 admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:15.172236 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 582/1190] 10.222.0.82 () {60 vars in 1483 bytes} [Fri Aug 19 01:28:15 2022] PUT /identity/v3/projects/82c77061f3a744ba833f737a98288bdb/users/d006c20be0374f19a8dcbad86bdf55b7/roles/fda5389edef24d6baac46d87242d285b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:28:21.592776 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c04a59-19e3-4ee5-af8d-b30a8d3c079c None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:21.593326 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c04a59-19e3-4ee5-af8d-b30a8d3c079c None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:21.594230 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c04a59-19e3-4ee5-af8d-b30a8d3c079c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:21.641057 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-b2c04a59-19e3-4ee5-af8d-b30a8d3c079c None None] MFA Rules not processed for user `cbf9c320e576418d9c932bcd895abe5c`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:21.642437 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-b2c04a59-19e3-4ee5-af8d-b30a8d3c079c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:21.744621 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:28:21.781208 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 609/1191] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:28:21 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:28:21.793373 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe88814-e11b-4106-95f0-1cb4a2d04e28 admin admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:21.795245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-bfe88814-e11b-4106-95f0-1cb4a2d04e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:21.859811 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:28:21.880320 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe88814-e11b-4106-95f0-1cb4a2d04e28 admin admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:21.887732 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e163f8f-df58-44da-affc-f61f91aff767 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd2faa457434dc6bfec69ecfa952ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:21.888539 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e163f8f-df58-44da-affc-f61f91aff767 service glance] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:21.888813 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e163f8f-df58-44da-affc-f61f91aff767 service glance] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:21.889134 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e163f8f-df58-44da-affc-f61f91aff767 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:21.966713 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e163f8f-df58-44da-affc-f61f91aff767 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:21.969569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e163f8f-df58-44da-affc-f61f91aff767 service glance] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:21.981559 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 583/1192] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:28:21 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:28:22.550828 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aa044-07bb-48ae-9c16-27446d9bf192 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:22.551122 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aa044-07bb-48ae-9c16-27446d9bf192 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:22.551400 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aa044-07bb-48ae-9c16-27446d9bf192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:22.583507 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-c31aa044-07bb-48ae-9c16-27446d9bf192 None None] MFA Rules not processed for user `d006c20be0374f19a8dcbad86bdf55b7`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:22.586192 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-c31aa044-07bb-48ae-9c16-27446d9bf192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:22.689224 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 610/1193] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:28:22 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:28:22.690342 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e163f8f-df58-44da-affc-f61f91aff767 service glance] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:22.690342 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e163f8f-df58-44da-affc-f61f91aff767 service glance] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:22.693472 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a04808-db00-4ac5-86a6-7496201d16b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd2faa457434dc6bfec69ecfa952ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:22.694212 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a04808-db00-4ac5-86a6-7496201d16b5 service glance] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:22.694529 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a04808-db00-4ac5-86a6-7496201d16b5 service glance] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:22.695468 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a04808-db00-4ac5-86a6-7496201d16b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:22.765848 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a04808-db00-4ac5-86a6-7496201d16b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:22.767313 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a04808-db00-4ac5-86a6-7496201d16b5 service glance] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:22.778723 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 584/1194] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:28:22 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:28:32.358034 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6429da8-b7f4-4d58-9156-3065aa19e0e4 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:32.358567 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6429da8-b7f4-4d58-9156-3065aa19e0e4 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:32.358735 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6429da8-b7f4-4d58-9156-3065aa19e0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:32.391092 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-c6429da8-b7f4-4d58-9156-3065aa19e0e4 None None] MFA Rules not processed for user `99695a3ad43943dcbb8d32b57abafce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:32.392907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-c6429da8-b7f4-4d58-9156-3065aa19e0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:32.403095 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 611/1195] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:28:32 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:28:32.729822 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8904213-e251-458f-8fcb-272a0b2d449a None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:32.729822 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8904213-e251-458f-8fcb-272a0b2d449a None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:32.730442 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8904213-e251-458f-8fcb-272a0b2d449a None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:32.731663 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 585/1196] 10.222.0.82 () {54 vars in 962 bytes} [Fri Aug 19 01:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:28:32.738075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e6b4a-e022-4aa9-aa98-f11c10e0fc1e None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:32.738367 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e6b4a-e022-4aa9-aa98-f11c10e0fc1e None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:32.738646 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e6b4a-e022-4aa9-aa98-f11c10e0fc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:32.763372 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-5a1e6b4a-e022-4aa9-aa98-f11c10e0fc1e None None] MFA Rules not processed for user `ea9fe590dcf441b09f4fe18bf3d8a7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:32.765062 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-5a1e6b4a-e022-4aa9-aa98-f11c10e0fc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:32.777594 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=60 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:28:32.833666 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 612/1197] 10.222.0.82 () {58 vars in 1059 bytes} [Fri Aug 19 01:28:32 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:28:32.845719 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21541c51-a9ba-4496-adb0-fdb981db734e None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:32.846014 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21541c51-a9ba-4496-adb0-fdb981db734e None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:32.846289 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21541c51-a9ba-4496-adb0-fdb981db734e None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:32.847670 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 586/1198] 10.222.0.82 () {54 vars in 912 bytes} [Fri Aug 19 01:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:28:32.856001 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21dce-9fb0-4153-bb92-f32543f5a3a8 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:32.856775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21dce-9fb0-4153-bb92-f32543f5a3a8 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:32.856775 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21dce-9fb0-4153-bb92-f32543f5a3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:32.883634 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-7af21dce-9fb0-4153-bb92-f32543f5a3a8 None None] MFA Rules not processed for user `ea9fe590dcf441b09f4fe18bf3d8a7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:32.885276 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-7af21dce-9fb0-4153-bb92-f32543f5a3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:32.898511 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 613/1199] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Aug 19 01:28:32 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:28:32.922680 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21541c51-a9ba-4496-adb0-fdb981db734e None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:32.924579 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-21541c51-a9ba-4496-adb0-fdb981db734e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:32.938747 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21541c51-a9ba-4496-adb0-fdb981db734e None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:32.942846 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675e1cc-8096-4cd2-b26d-f95ba47fb825 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd2faa457434dc6bfec69ecfa952ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:32.943449 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675e1cc-8096-4cd2-b26d-f95ba47fb825 service glance] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:32.943791 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675e1cc-8096-4cd2-b26d-f95ba47fb825 service glance] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:32.944070 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675e1cc-8096-4cd2-b26d-f95ba47fb825 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:32.953945 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675e1cc-8096-4cd2-b26d-f95ba47fb825 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:32.955495 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675e1cc-8096-4cd2-b26d-f95ba47fb825 service glance] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:32.968914 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 587/1200] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:28:32 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:28:33.364086 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afd439-6a19-45ee-95f2-f6aebc30d903 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:33.364631 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afd439-6a19-45ee-95f2-f6aebc30d903 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:33.364631 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afd439-6a19-45ee-95f2-f6aebc30d903 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:33.365982 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 614/1201] 10.222.0.82 () {54 vars in 912 bytes} [Fri Aug 19 01:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:28:33.372637 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7d10e-b2de-4ddc-868a-a67ac552bb9b None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:33.373144 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7d10e-b2de-4ddc-868a-a67ac552bb9b None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:33.373661 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7d10e-b2de-4ddc-868a-a67ac552bb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:33.404015 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-27e7d10e-b2de-4ddc-868a-a67ac552bb9b None None] MFA Rules not processed for user `51d3ab73e09b4d94b06df7eaf1d8b85e`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:33.405564 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-27e7d10e-b2de-4ddc-868a-a67ac552bb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:33.469364 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 588/1202] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Aug 19 01:28:33 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:28:33.481149 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afd439-6a19-45ee-95f2-f6aebc30d903 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:33.482900 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-94afd439-6a19-45ee-95f2-f6aebc30d903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:33.496816 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afd439-6a19-45ee-95f2-f6aebc30d903 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:33.500457 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e201b-4037-4cea-a13a-4392f4449ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:33.501085 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e201b-4037-4cea-a13a-4392f4449ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:33.501357 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e201b-4037-4cea-a13a-4392f4449ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:33.501623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e201b-4037-4cea-a13a-4392f4449ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:33.510669 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e201b-4037-4cea-a13a-4392f4449ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:33.512215 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e201b-4037-4cea-a13a-4392f4449ab7 service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:33.521645 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 615/1203] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:28:33 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:28:34.010125 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf007a5c-09e9-4a6d-bd2d-312c67aff889 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:34.010649 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf007a5c-09e9-4a6d-bd2d-312c67aff889 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:34.010747 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf007a5c-09e9-4a6d-bd2d-312c67aff889 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:34.012265 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 589/1204] 10.222.0.82 () {54 vars in 962 bytes} [Fri Aug 19 01:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:28:34.017982 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f3ac4-5f85-4e09-bbde-c3ca683f1542 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:34.018412 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f3ac4-5f85-4e09-bbde-c3ca683f1542 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:34.018778 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f3ac4-5f85-4e09-bbde-c3ca683f1542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:34.020043 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248cf05-5141-43d7-9f8c-0435b306a104 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:34.020329 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248cf05-5141-43d7-9f8c-0435b306a104 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:34.020605 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248cf05-5141-43d7-9f8c-0435b306a104 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:34.022140 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 590/1205] 10.222.0.82 () {54 vars in 961 bytes} [Fri Aug 19 01:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:28:34.027358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce8b44-16af-43fb-97f4-1b7696e0a316 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:34.027640 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce8b44-16af-43fb-97f4-1b7696e0a316 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:34.027939 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce8b44-16af-43fb-97f4-1b7696e0a316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:34.041469 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-482f3ac4-5f85-4e09-bbde-c3ca683f1542 None None] MFA Rules not processed for user `ea9fe590dcf441b09f4fe18bf3d8a7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:34.042694 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-482f3ac4-5f85-4e09-bbde-c3ca683f1542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:34.048016 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-c8ce8b44-16af-43fb-97f4-1b7696e0a316 None None] MFA Rules not processed for user `246b63ecc51347f08daad24d75e3de27`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:34.049243 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-c8ce8b44-16af-43fb-97f4-1b7696e0a316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:34.052808 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 616/1206] 10.222.0.82 () {58 vars in 1059 bytes} [Fri Aug 19 01:28:34 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:28:34.058657 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cf1ba-db31-4b31-a2d4-9e7e16b75e70 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:34.059381 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cf1ba-db31-4b31-a2d4-9e7e16b75e70 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:34.059381 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cf1ba-db31-4b31-a2d4-9e7e16b75e70 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:34.060868 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 617/1207] 10.222.0.82 () {54 vars in 912 bytes} [Fri Aug 19 01:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:28:34.065952 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d39e2a-b49f-477b-8067-d00b52f3dcde None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:34.066443 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d39e2a-b49f-477b-8067-d00b52f3dcde None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:34.066720 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d39e2a-b49f-477b-8067-d00b52f3dcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:34.087745 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-17d39e2a-b49f-477b-8067-d00b52f3dcde None None] MFA Rules not processed for user `ea9fe590dcf441b09f4fe18bf3d8a7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:34.089259 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-17d39e2a-b49f-477b-8067-d00b52f3dcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:34.099195 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 618/1208] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Aug 19 01:28:34 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:28:34.113180 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d39e2a-b49f-477b-8067-d00b52f3dcde None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:34.124362 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d39e2a-b49f-477b-8067-d00b52f3dcde None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:34.129124 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 591/1209] 10.222.0.82 () {58 vars in 1058 bytes} [Fri Aug 19 01:28:34 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:28:34.130737 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf82fda-9d2a-4cd0-ab22-bcc1f2e0890d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:34.131457 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf82fda-9d2a-4cd0-ab22-bcc1f2e0890d service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:34.131802 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf82fda-9d2a-4cd0-ab22-bcc1f2e0890d service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:34.133009 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf82fda-9d2a-4cd0-ab22-bcc1f2e0890d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:34.146275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf82fda-9d2a-4cd0-ab22-bcc1f2e0890d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:34.147662 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf82fda-9d2a-4cd0-ab22-bcc1f2e0890d service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:34.149762 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce8b44-16af-43fb-97f4-1b7696e0a316 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:34.160146 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 619/1210] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:28:34 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:28:34.169090 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce8b44-16af-43fb-97f4-1b7696e0a316 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:34.169090 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9288fb0-c063-4af7-8457-d9f258e5c0db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '246b63ecc51347f08daad24d75e3de27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:34.172053 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9288fb0-c063-4af7-8457-d9f258e5c0db service placement] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:34.172508 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9288fb0-c063-4af7-8457-d9f258e5c0db service placement] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:34.172962 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9288fb0-c063-4af7-8457-d9f258e5c0db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:34.175447 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-f9288fb0-c063-4af7-8457-d9f258e5c0db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:34.189952 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9288fb0-c063-4af7-8457-d9f258e5c0db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:34.192113 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9288fb0-c063-4af7-8457-d9f258e5c0db service placement] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:34.205437 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 592/1211] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:28:34 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 01:28:44.155264 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=91 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:28:44.199905 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=64 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:28:48.600649 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7900596-cc2a-4485-9534-286cc61d6943 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:48.602176 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7900596-cc2a-4485-9534-286cc61d6943 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:48.602176 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7900596-cc2a-4485-9534-286cc61d6943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:48.621590 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-a7900596-cc2a-4485-9534-286cc61d6943 None None] MFA Rules not processed for user `51d3ab73e09b4d94b06df7eaf1d8b85e`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:48.622822 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-a7900596-cc2a-4485-9534-286cc61d6943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:48.629613 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 620/1212] 10.222.0.58 () {58 vars in 1015 bytes} [Fri Aug 19 01:28:48 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:28:48.641385 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9288fb0-c063-4af7-8457-d9f258e5c0db service placement] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:48.652000 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9288fb0-c063-4af7-8457-d9f258e5c0db service placement] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:48.655635 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeec1bb-3af2-419b-892d-7cea13f77f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:48.656272 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeec1bb-3af2-419b-892d-7cea13f77f18 service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:48.656580 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeec1bb-3af2-419b-892d-7cea13f77f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:48.656864 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeec1bb-3af2-419b-892d-7cea13f77f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:48.664732 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeec1bb-3af2-419b-892d-7cea13f77f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:48.666214 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeec1bb-3af2-419b-892d-7cea13f77f18 service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:48.678808 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 593/1213] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:28:48 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:28:49.765342 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbe475-6ec2-4669-bb5b-62a1dc884940 None None] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:49.765937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbe475-6ec2-4669-bb5b-62a1dc884940 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:49.765937 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbe475-6ec2-4669-bb5b-62a1dc884940 None None] PATH_INFO: `/` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:49.767266 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 621/1214] 10.222.0.82 () {54 vars in 921 bytes} [Fri Aug 19 01:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:28:49.772174 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c7707-a4fb-4732-9fdf-61e702c529b0 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:49.772745 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c7707-a4fb-4732-9fdf-61e702c529b0 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:49.776648 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c7707-a4fb-4732-9fdf-61e702c529b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:49.795942 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-b77c7707-a4fb-4732-9fdf-61e702c529b0 None None] MFA Rules not processed for user `ea9fe590dcf441b09f4fe18bf3d8a7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:49.799865 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-b77c7707-a4fb-4732-9fdf-61e702c529b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:49.806471 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 594/1215] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Aug 19 01:28:49 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:28:49.820607 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbe475-6ec2-4669-bb5b-62a1dc884940 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:49.834546 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbe475-6ec2-4669-bb5b-62a1dc884940 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:49.841180 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefe1b0-6548-455d-9d05-d09117d3b095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:49.841797 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefe1b0-6548-455d-9d05-d09117d3b095 service nova] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:49.842079 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefe1b0-6548-455d-9d05-d09117d3b095 service nova] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:49.844246 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefe1b0-6548-455d-9d05-d09117d3b095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:49.855766 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefe1b0-6548-455d-9d05-d09117d3b095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:49.857428 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefe1b0-6548-455d-9d05-d09117d3b095 service nova] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:49.869764 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 622/1216] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:28:49 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:28:58.135855 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0918ad-9cc1-48a9-b1dd-bf9b574e7f4f None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:58.136430 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0918ad-9cc1-48a9-b1dd-bf9b574e7f4f None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:58.136430 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0918ad-9cc1-48a9-b1dd-bf9b574e7f4f None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:58.139582 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 595/1217] 10.222.0.82 () {54 vars in 921 bytes} [Fri Aug 19 01:28:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 01:28:58.148580 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21900bde-25fb-400d-8505-d3efe9babfb2 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:58.149116 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21900bde-25fb-400d-8505-d3efe9babfb2 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:58.149417 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21900bde-25fb-400d-8505-d3efe9babfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:58.173621 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-21900bde-25fb-400d-8505-d3efe9babfb2 None None] MFA Rules not processed for user `ea9fe590dcf441b09f4fe18bf3d8a7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:28:58.174833 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-21900bde-25fb-400d-8505-d3efe9babfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:28:58.184440 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 623/1218] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Aug 19 01:28:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:28:58.196796 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0918ad-9cc1-48a9-b1dd-bf9b574e7f4f None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:28:58.210568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0918ad-9cc1-48a9-b1dd-bf9b574e7f4f None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:28:58.215815 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dee0d5-e2a2-4639-b353-56b542b1c733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:28:58.216411 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dee0d5-e2a2-4639-b353-56b542b1c733 service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:28:58.216690 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dee0d5-e2a2-4639-b353-56b542b1c733 service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:28:58.217005 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dee0d5-e2a2-4639-b353-56b542b1c733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:28:58.228205 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dee0d5-e2a2-4639-b353-56b542b1c733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:28:58.229933 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dee0d5-e2a2-4639-b353-56b542b1c733 service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:28:58.241027 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 596/1219] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:28:58 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 01:29:08.168201 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=12 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:29:08.236492 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=15 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:29:14.957723 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21900bde-25fb-400d-8505-d3efe9babfb2 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:29:14.967140 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21900bde-25fb-400d-8505-d3efe9babfb2 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:29:14.970716 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c657e86-3452-47cc-878f-25f238ae7e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:29:14.971440 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c657e86-3452-47cc-878f-25f238ae7e1d service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:29:14.971624 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c657e86-3452-47cc-878f-25f238ae7e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:29:14.971826 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c657e86-3452-47cc-878f-25f238ae7e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:29:14.981465 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c657e86-3452-47cc-878f-25f238ae7e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:29:14.982922 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c657e86-3452-47cc-878f-25f238ae7e1d service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:29:14.992244 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 624/1220] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:29:14 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:29:24.988057 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=6 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:30:22.217566 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257f5b1-cb00-4273-8062-eec810da0965 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:30:22.218125 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257f5b1-cb00-4273-8062-eec810da0965 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:30:22.218125 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257f5b1-cb00-4273-8062-eec810da0965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:30:22.236784 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-2257f5b1-cb00-4273-8062-eec810da0965 None None] MFA Rules not processed for user `8405945d089b4d319d325c1b9ab0f857`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:30:22.238006 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-2257f5b1-cb00-4273-8062-eec810da0965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:30:22.245287 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 597/1221] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:30:22 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:30:32.232095 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=3 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:30:59.277601 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35263a-79ae-491c-b7f3-38b01d057719 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:30:59.278106 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35263a-79ae-491c-b7f3-38b01d057719 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:30:59.278209 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35263a-79ae-491c-b7f3-38b01d057719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:30:59.308355 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-bd35263a-79ae-491c-b7f3-38b01d057719 None None] MFA Rules not processed for user `8405945d089b4d319d325c1b9ab0f857`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:30:59.309599 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-bd35263a-79ae-491c-b7f3-38b01d057719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:30:59.352487 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 625/1222] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:30:59 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:31:09.333774 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=15 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:31:17.866790 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5b6eb-cc2e-49a3-8177-62363f95097b None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:31:17.867236 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5b6eb-cc2e-49a3-8177-62363f95097b None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:31:17.867331 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5b6eb-cc2e-49a3-8177-62363f95097b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:31:17.887098 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-d5b5b6eb-cc2e-49a3-8177-62363f95097b None None] MFA Rules not processed for user `8405945d089b4d319d325c1b9ab0f857`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:31:17.888286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-d5b5b6eb-cc2e-49a3-8177-62363f95097b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:31:17.895212 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 598/1223] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:31:17 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:31:18.160496 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cd918-ee07-42d9-b2ce-894e9bcdc997 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:31:18.160982 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cd918-ee07-42d9-b2ce-894e9bcdc997 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:31:18.161070 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cd918-ee07-42d9-b2ce-894e9bcdc997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:31:18.217634 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-638cd918-ee07-42d9-b2ce-894e9bcdc997 None None] MFA Rules not processed for user `51d3ab73e09b4d94b06df7eaf1d8b85e`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:31:18.218850 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-638cd918-ee07-42d9-b2ce-894e9bcdc997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:31:18.250685 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 626/1224] 10.222.0.82 () {58 vars in 1009 bytes} [Fri Aug 19 01:31:18 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:31:18.261817 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5b6eb-cc2e-49a3-8177-62363f95097b None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:31:18.271449 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5b6eb-cc2e-49a3-8177-62363f95097b None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:31:18.274924 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c6ba6-6ee8-4a78-9efb-83216371ed0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:31:18.275516 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c6ba6-6ee8-4a78-9efb-83216371ed0d service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:31:18.275845 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c6ba6-6ee8-4a78-9efb-83216371ed0d service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:31:18.276116 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c6ba6-6ee8-4a78-9efb-83216371ed0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:31:18.283749 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c6ba6-6ee8-4a78-9efb-83216371ed0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:31:18.285219 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c6ba6-6ee8-4a78-9efb-83216371ed0d service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:31:18.293401 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 599/1225] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:31:18 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:31:28.247798 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=28 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:31:28.289552 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=9 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:31:39.065710 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cd918-ee07-42d9-b2ce-894e9bcdc997 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:31:39.095572 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cd918-ee07-42d9-b2ce-894e9bcdc997 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:31:39.101112 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03ff25-8806-46cc-870d-c09c52982e3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '246b63ecc51347f08daad24d75e3de27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:31:39.101734 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03ff25-8806-46cc-870d-c09c52982e3d service placement] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:31:39.102036 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03ff25-8806-46cc-870d-c09c52982e3d service placement] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:31:39.102310 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03ff25-8806-46cc-870d-c09c52982e3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:31:39.111351 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03ff25-8806-46cc-870d-c09c52982e3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:31:39.112982 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03ff25-8806-46cc-870d-c09c52982e3d service placement] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:31:39.122582 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 627/1226] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:31:39 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:31:49.118572 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=13 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:32:37.243273 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2233b66-f4ca-431a-b4e8-fac3aea12748 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:32:37.243771 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2233b66-f4ca-431a-b4e8-fac3aea12748 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:32:37.243864 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2233b66-f4ca-431a-b4e8-fac3aea12748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:32:37.263544 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-b2233b66-f4ca-431a-b4e8-fac3aea12748 None None] MFA Rules not processed for user `8405945d089b4d319d325c1b9ab0f857`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:32:37.264721 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-b2233b66-f4ca-431a-b4e8-fac3aea12748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:32:37.271450 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 600/1227] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:32:37 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:32:47.258846 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=3 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:32:52.703476 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03ff25-8806-46cc-870d-c09c52982e3d service placement] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:32:52.712705 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03ff25-8806-46cc-870d-c09c52982e3d service placement] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:32:52.716263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9b203-470d-418c-9433-d03ac98b80c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:32:52.716869 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9b203-470d-418c-9433-d03ac98b80c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:32:52.717170 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9b203-470d-418c-9433-d03ac98b80c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:32:52.717467 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9b203-470d-418c-9433-d03ac98b80c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:32:52.726216 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9b203-470d-418c-9433-d03ac98b80c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:32:52.727735 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9b203-470d-418c-9433-d03ac98b80c2 service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:32:52.737023 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 628/1228] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:32:52 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:33:02.732968 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=6 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:33:59.756812 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2233b66-f4ca-431a-b4e8-fac3aea12748 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:33:59.778882 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2233b66-f4ca-431a-b4e8-fac3aea12748 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:33:59.784056 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acb5e9-40fc-4c84-bec7-b1dcd6bc3b60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:33:59.784648 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acb5e9-40fc-4c84-bec7-b1dcd6bc3b60 service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:33:59.785083 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acb5e9-40fc-4c84-bec7-b1dcd6bc3b60 service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:33:59.785365 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acb5e9-40fc-4c84-bec7-b1dcd6bc3b60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:33:59.794394 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acb5e9-40fc-4c84-bec7-b1dcd6bc3b60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:33:59.798824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acb5e9-40fc-4c84-bec7-b1dcd6bc3b60 service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:33:59.805125 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 601/1229] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:33:59 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:33:59.860168 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9b203-470d-418c-9433-d03ac98b80c2 service neutron] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:33:59.869520 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9b203-470d-418c-9433-d03ac98b80c2 service neutron] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:33:59.873607 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789f3ca-e28f-40ae-b111-d420cd7d0c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:33:59.874206 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789f3ca-e28f-40ae-b111-d420cd7d0c6e service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:33:59.874482 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789f3ca-e28f-40ae-b111-d420cd7d0c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:33:59.874947 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789f3ca-e28f-40ae-b111-d420cd7d0c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:33:59.884420 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789f3ca-e28f-40ae-b111-d420cd7d0c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:33:59.885882 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789f3ca-e28f-40ae-b111-d420cd7d0c6e service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:33:59.895972 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 629/1230] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:33:59 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:34:00.409090 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acb5e9-40fc-4c84-bec7-b1dcd6bc3b60 service nova] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:34:00.422046 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acb5e9-40fc-4c84-bec7-b1dcd6bc3b60 service nova] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:34:00.431067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9cf70-880c-41b6-accc-77c9b3c5e8be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:34:00.432779 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9cf70-880c-41b6-accc-77c9b3c5e8be service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:34:00.433296 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9cf70-880c-41b6-accc-77c9b3c5e8be service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:34:00.433824 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9cf70-880c-41b6-accc-77c9b3c5e8be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:34:00.445813 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9cf70-880c-41b6-accc-77c9b3c5e8be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:34:00.449299 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9cf70-880c-41b6-accc-77c9b3c5e8be service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:34:00.461560 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 602/1231] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:34:00 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:34:00.543316 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789f3ca-e28f-40ae-b111-d420cd7d0c6e service neutron] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:34:00.558599 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789f3ca-e28f-40ae-b111-d420cd7d0c6e service neutron] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:34:00.560698 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b634983-cff3-403d-bc72-610c5e3ac406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:34:00.561598 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b634983-cff3-403d-bc72-610c5e3ac406 service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:34:00.562132 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b634983-cff3-403d-bc72-610c5e3ac406 service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:34:00.562439 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b634983-cff3-403d-bc72-610c5e3ac406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:34:00.570724 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b634983-cff3-403d-bc72-610c5e3ac406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:34:00.573152 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b634983-cff3-403d-bc72-610c5e3ac406 service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:34:00.582643 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 630/1232] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:34:00 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:34:01.861122 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965264b-9d9c-43ca-9c03-2bd48218bb74 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:34:01.861972 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965264b-9d9c-43ca-9c03-2bd48218bb74 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:34:01.862298 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965264b-9d9c-43ca-9c03-2bd48218bb74 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:34:01.863855 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 603/1233] 10.222.0.82 () {54 vars in 921 bytes} [Fri Aug 19 01:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:34:01.869257 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe5de9-28c1-48e5-b28f-88445fbb8658 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:34:01.869957 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe5de9-28c1-48e5-b28f-88445fbb8658 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:34:01.870370 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe5de9-28c1-48e5-b28f-88445fbb8658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:34:01.932095 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-66fe5de9-28c1-48e5-b28f-88445fbb8658 None None] MFA Rules not processed for user `ea9fe590dcf441b09f4fe18bf3d8a7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:34:01.933626 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-66fe5de9-28c1-48e5-b28f-88445fbb8658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:34:01.943713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 631/1234] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Aug 19 01:34:01 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:34:01.957961 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965264b-9d9c-43ca-9c03-2bd48218bb74 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:34:01.979145 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965264b-9d9c-43ca-9c03-2bd48218bb74 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:34:01.984328 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40170b27-7e6a-404e-8789-882ce822ffe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:34:01.985087 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40170b27-7e6a-404e-8789-882ce822ffe4 service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:34:01.985429 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40170b27-7e6a-404e-8789-882ce822ffe4 service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:34:01.985768 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40170b27-7e6a-404e-8789-882ce822ffe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:34:01.994896 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40170b27-7e6a-404e-8789-882ce822ffe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:34:01.996555 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40170b27-7e6a-404e-8789-882ce822ffe4 service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:34:02.013045 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 604/1235] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:34:01 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:34:11.928613 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=26 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:34:12.003893 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=22 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:34:13.680713 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe5de9-28c1-48e5-b28f-88445fbb8658 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:34:13.690530 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe5de9-28c1-48e5-b28f-88445fbb8658 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:34:13.696377 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4d6a-4270-421e-8107-fde39b687813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:34:13.696377 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4d6a-4270-421e-8107-fde39b687813 service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:34:13.696377 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4d6a-4270-421e-8107-fde39b687813 service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:34:13.696377 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4d6a-4270-421e-8107-fde39b687813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:34:13.705820 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a4d6a-4270-421e-8107-fde39b687813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:34:13.707258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a4d6a-4270-421e-8107-fde39b687813 service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:34:13.717563 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 632/1236] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:34:13 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:34:23.712897 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=6 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:34:24.483918 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf3d06-6798-4c37-bf0a-d728f8003684 None None] REQUEST_METHOD: `POST` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:34:24.484438 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf3d06-6798-4c37-bf0a-d728f8003684 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:34:24.484438 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf3d06-6798-4c37-bf0a-d728f8003684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:34:24.502764 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.auth.core [None req-47bf3d06-6798-4c37-bf0a-d728f8003684 None None] MFA Rules not processed for user `99695a3ad43943dcbb8d32b57abafce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88725) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:34:24.503938 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-47bf3d06-6798-4c37-bf0a-d728f8003684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:34:24.510777 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 605/1237] 10.222.0.82 () {58 vars in 958 bytes} [Fri Aug 19 01:34:24 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 01:34:25.233756 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4d6a-4270-421e-8107-fde39b687813 service neutron] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:34:25.245461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4d6a-4270-421e-8107-fde39b687813 service neutron] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:34:25.251248 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3d59e-0bb3-4424-8858-a8f9b06820f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '246b63ecc51347f08daad24d75e3de27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:34:25.251856 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3d59e-0bb3-4424-8858-a8f9b06820f5 service placement] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:34:25.252133 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3d59e-0bb3-4424-8858-a8f9b06820f5 service placement] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:34:25.252407 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3d59e-0bb3-4424-8858-a8f9b06820f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:34:25.261301 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3d59e-0bb3-4424-8858-a8f9b06820f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:34:25.263008 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3d59e-0bb3-4424-8858-a8f9b06820f5 service placement] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:34:25.273124 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 633/1238] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:34:25 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:34:34.498082 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=3 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:34:35.268939 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=6 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:34:43.844556 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf3d06-6798-4c37-bf0a-d728f8003684 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:34:43.855815 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf3d06-6798-4c37-bf0a-d728f8003684 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:34:43.861536 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7b809-84ce-49b8-af4c-b6ab5acc4943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:34:43.873482 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7b809-84ce-49b8-af4c-b6ab5acc4943 service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:34:43.873482 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7b809-84ce-49b8-af4c-b6ab5acc4943 service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:34:43.873482 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7b809-84ce-49b8-af4c-b6ab5acc4943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:34:43.873482 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7b809-84ce-49b8-af4c-b6ab5acc4943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:34:43.873861 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7b809-84ce-49b8-af4c-b6ab5acc4943 service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:34:43.884032 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 606/1239] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:34:43 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:34:53.879655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=6 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:34:55.038528 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3d59e-0bb3-4424-8858-a8f9b06820f5 service placement] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:34:55.048623 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3d59e-0bb3-4424-8858-a8f9b06820f5 service placement] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:34:55.052330 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf32366-be03-4585-bbc1-68822fef337d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:34:55.052958 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf32366-be03-4585-bbc1-68822fef337d service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:34:55.053241 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf32366-be03-4585-bbc1-68822fef337d service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:34:55.053514 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf32366-be03-4585-bbc1-68822fef337d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:34:55.063746 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf32366-be03-4585-bbc1-68822fef337d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:34:55.065133 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf32366-be03-4585-bbc1-68822fef337d service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:34:55.074498 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 634/1240] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:34:55 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:35:05.070380 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=6 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:36:12.319445 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7b809-84ce-49b8-af4c-b6ab5acc4943 service nova] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:36:12.330666 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7b809-84ce-49b8-af4c-b6ab5acc4943 service nova] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:36:12.335757 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf94777-c316-452e-b309-8e3941c44430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea9fe590dcf441b09f4fe18bf3d8a7ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:36:12.336346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf94777-c316-452e-b309-8e3941c44430 service nova] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:36:12.336626 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf94777-c316-452e-b309-8e3941c44430 service nova] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:36:12.336931 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf94777-c316-452e-b309-8e3941c44430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:36:12.345428 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf94777-c316-452e-b309-8e3941c44430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:36:12.351021 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf94777-c316-452e-b309-8e3941c44430 service nova] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:36:12.356041 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 607/1241] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:36:12 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:36:22.351936 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=6 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:36:25.357599 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf32366-be03-4585-bbc1-68822fef337d service neutron] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:36:25.359637 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf32366-be03-4585-bbc1-68822fef337d service neutron] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:36:25.363217 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f554f-9f53-48ef-9935-2a8aec7926cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:36:25.363801 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f554f-9f53-48ef-9935-2a8aec7926cd service neutron] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:36:25.364075 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f554f-9f53-48ef-9935-2a8aec7926cd service neutron] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:36:25.364344 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f554f-9f53-48ef-9935-2a8aec7926cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:36:25.434724 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f554f-9f53-48ef-9935-2a8aec7926cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:36:25.436154 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f554f-9f53-48ef-9935-2a8aec7926cd service neutron] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:36:25.456088 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 635/1242] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:36:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:36:29.313830 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958fbca-d5e2-4c70-bda8-7eca082eec59 None None] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:36:29.314739 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958fbca-d5e2-4c70-bda8-7eca082eec59 None None] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:36:29.315159 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958fbca-d5e2-4c70-bda8-7eca082eec59 None None] PATH_INFO: `/` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:36:29.316725 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 608/1243] 10.222.0.82 () {54 vars in 921 bytes} [Fri Aug 19 01:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 01:36:29.349614 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d549f-622f-4ab2-9575-acd8d93ad6c0 None None] REQUEST_METHOD: `POST` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:36:29.355275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d549f-622f-4ab2-9575-acd8d93ad6c0 None None] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:36:29.355275 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d549f-622f-4ab2-9575-acd8d93ad6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:36:29.391570 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.auth.core [None req-a73d549f-622f-4ab2-9575-acd8d93ad6c0 None None] MFA Rules not processed for user `246b63ecc51347f08daad24d75e3de27`. Rule list: `[]` (Enabled: `True`). {{(pid=88726) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 01:36:29.392811 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-a73d549f-622f-4ab2-9575-acd8d93ad6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:36:29.401517 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 636/1244] 10.222.0.82 () {58 vars in 1018 bytes} [Fri Aug 19 01:36:29 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 01:36:29.413671 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958fbca-d5e2-4c70-bda8-7eca082eec59 None None] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:36:29.426806 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958fbca-d5e2-4c70-bda8-7eca082eec59 None None] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:36:29.432661 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97b476-1421-4da1-b138-024f1384c6a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '246b63ecc51347f08daad24d75e3de27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:36:29.433292 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97b476-1421-4da1-b138-024f1384c6a3 service placement] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:36:29.433568 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97b476-1421-4da1-b138-024f1384c6a3 service placement] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:36:29.433832 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97b476-1421-4da1-b138-024f1384c6a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:36:29.446627 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97b476-1421-4da1-b138-024f1384c6a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:36:29.453330 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97b476-1421-4da1-b138-024f1384c6a3 service placement] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:36:29.460956 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 609/1245] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:36:29 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:36:32.991317 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d549f-622f-4ab2-9575-acd8d93ad6c0 None None] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:36:33.003235 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d549f-622f-4ab2-9575-acd8d93ad6c0 None None] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:36:33.007890 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2239473-6bc8-48b8-9ede-3763c3b3d95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:36:33.008523 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2239473-6bc8-48b8-9ede-3763c3b3d95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:36:33.008820 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2239473-6bc8-48b8-9ede-3763c3b3d95c admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:36:33.009112 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2239473-6bc8-48b8-9ede-3763c3b3d95c admin admin] PATH_INFO: `/v3/users/8405945d089b4d319d325c1b9ab0f857` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:36:33.010240 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2239473-6bc8-48b8-9ede-3763c3b3d95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8405945d089b4d319d325c1b9ab0f857)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:36:33.011258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: WARNING py.warnings [None req-a2239473-6bc8-48b8-9ede-3763c3b3d95c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:36:33.011258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: warnings.warn(msg) Aug 19 01:36:33.011258 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: Aug 19 01:36:33.012454 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2239473-6bc8-48b8-9ede-3763c3b3d95c admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:36:33.183121 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-a2239473-6bc8-48b8-9ede-3763c3b3d95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8405945d089b4d319d325c1b9ab0f857'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:33.193279 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-a2239473-6bc8-48b8-9ede-3763c3b3d95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8405945d089b4d319d325c1b9ab0f857'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:33.193958 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-a2239473-6bc8-48b8-9ede-3763c3b3d95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8405945d089b4d319d325c1b9ab0f857'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:33.276319 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-a2239473-6bc8-48b8-9ede-3763c3b3d95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8405945d089b4d319d325c1b9ab0f857'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:33.276977 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-a2239473-6bc8-48b8-9ede-3763c3b3d95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8405945d089b4d319d325c1b9ab0f857'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:33.304505 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 637/1246] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Aug 19 01:36:32 2022] DELETE /identity/v3/users/8405945d089b4d319d325c1b9ab0f857 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:36:33.564286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97b476-1421-4da1-b138-024f1384c6a3 service placement] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:36:33.575279 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97b476-1421-4da1-b138-024f1384c6a3 service placement] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:36:33.631521 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e691ef6-a65e-49b4-833e-4bb78a3115c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:36:33.632140 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e691ef6-a65e-49b4-833e-4bb78a3115c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:36:33.632442 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e691ef6-a65e-49b4-833e-4bb78a3115c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:36:33.632710 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e691ef6-a65e-49b4-833e-4bb78a3115c4 admin admin] PATH_INFO: `/v3/projects/75dc2efddbec4981b5037bb428068c23` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:36:33.633877 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e691ef6-a65e-49b4-833e-4bb78a3115c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75dc2efddbec4981b5037bb428068c23)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:36:33.634912 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: WARNING py.warnings [None req-5e691ef6-a65e-49b4-833e-4bb78a3115c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 01:36:33.634912 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: warnings.warn(msg) Aug 19 01:36:33.634912 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: Aug 19 01:36:33.636101 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e691ef6-a65e-49b4-833e-4bb78a3115c4 admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:36:33.763441 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-5e691ef6-a65e-49b4-833e-4bb78a3115c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75dc2efddbec4981b5037bb428068c23', 'request_id': 'req-5e691ef6-a65e-49b4-833e-4bb78a3115c4'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:33.770567 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-5e691ef6-a65e-49b4-833e-4bb78a3115c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75dc2efddbec4981b5037bb428068c23', 'request_id': 'req-5e691ef6-a65e-49b4-833e-4bb78a3115c4'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:33.842001 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-5e691ef6-a65e-49b4-833e-4bb78a3115c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75dc2efddbec4981b5037bb428068c23', 'request_id': 'req-5e691ef6-a65e-49b4-833e-4bb78a3115c4'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:33.873644 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-5e691ef6-a65e-49b4-833e-4bb78a3115c4 admin admin] The token cache is being invalidate because project 75dc2efddbec4981b5037bb428068c23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88725) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 01:36:33.873935 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-5e691ef6-a65e-49b4-833e-4bb78a3115c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:33.874569 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-5e691ef6-a65e-49b4-833e-4bb78a3115c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:33.877174 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 610/1247] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Aug 19 01:36:33 2022] DELETE /identity/v3/projects/75dc2efddbec4981b5037bb428068c23 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:36:33.881413 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2239473-6bc8-48b8-9ede-3763c3b3d95c admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:36:33.882911 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-a2239473-6bc8-48b8-9ede-3763c3b3d95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:36:33.897548 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2239473-6bc8-48b8-9ede-3763c3b3d95c admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:36:33.924154 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:36:33.954988 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676af75b-25f3-40fe-9365-f4af32525301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:36:33.955989 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676af75b-25f3-40fe-9365-f4af32525301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:36:33.956286 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676af75b-25f3-40fe-9365-f4af32525301 admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:36:33.956739 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676af75b-25f3-40fe-9365-f4af32525301 admin admin] PATH_INFO: `/v3/users/cbf9c320e576418d9c932bcd895abe5c` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:36:33.958297 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676af75b-25f3-40fe-9365-f4af32525301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbf9c320e576418d9c932bcd895abe5c)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:36:33.960300 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676af75b-25f3-40fe-9365-f4af32525301 admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:36:34.147320 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-676af75b-25f3-40fe-9365-f4af32525301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbf9c320e576418d9c932bcd895abe5c'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:34.154695 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-676af75b-25f3-40fe-9365-f4af32525301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbf9c320e576418d9c932bcd895abe5c'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:34.155376 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-676af75b-25f3-40fe-9365-f4af32525301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbf9c320e576418d9c932bcd895abe5c'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:34.224263 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-676af75b-25f3-40fe-9365-f4af32525301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbf9c320e576418d9c932bcd895abe5c'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:34.224907 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-676af75b-25f3-40fe-9365-f4af32525301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbf9c320e576418d9c932bcd895abe5c'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:34.243390 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 638/1248] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Aug 19 01:36:33 2022] DELETE /identity/v3/users/cbf9c320e576418d9c932bcd895abe5c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:36:34.460895 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e691ef6-a65e-49b4-833e-4bb78a3115c4 admin admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:36:34.462979 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-5e691ef6-a65e-49b4-833e-4bb78a3115c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:36:34.477822 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e691ef6-a65e-49b4-833e-4bb78a3115c4 admin admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:36:34.535836 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:36:34.536456 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:36:34.536763 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:36:34.537030 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db admin admin] PATH_INFO: `/v3/projects/f024157151114ffaade10e14abbba8c4` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:36:34.538136 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=f024157151114ffaade10e14abbba8c4)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:36:34.540097 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:36:34.548384 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:36:34.681494 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f024157151114ffaade10e14abbba8c4', 'request_id': 'req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:34.686915 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f024157151114ffaade10e14abbba8c4', 'request_id': 'req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:34.773067 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f024157151114ffaade10e14abbba8c4', 'request_id': 'req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:34.784901 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db admin admin] The token cache is being invalidate because project f024157151114ffaade10e14abbba8c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88725) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 01:36:34.785181 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:34.785801 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:36:34.789465 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 611/1249] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Aug 19 01:36:34 2022] DELETE /identity/v3/projects/f024157151114ffaade10e14abbba8c4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:36:39.949254 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676af75b-25f3-40fe-9365-f4af32525301 admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:36:39.950669 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-676af75b-25f3-40fe-9365-f4af32525301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:36:40.030164 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676af75b-25f3-40fe-9365-f4af32525301 admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:36:40.067821 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:36:40.088708 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8d8a1-53b8-4a50-b69a-f1f316cf1c93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '246b63ecc51347f08daad24d75e3de27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:36:40.089341 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8d8a1-53b8-4a50-b69a-f1f316cf1c93 service placement] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:36:40.089619 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8d8a1-53b8-4a50-b69a-f1f316cf1c93 service placement] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:36:40.089887 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8d8a1-53b8-4a50-b69a-f1f316cf1c93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:36:40.091635 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-5cc8d8a1-53b8-4a50-b69a-f1f316cf1c93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:36:40.102862 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8d8a1-53b8-4a50-b69a-f1f316cf1c93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:36:40.104433 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8d8a1-53b8-4a50-b69a-f1f316cf1c93 service placement] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:36:40.114374 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 639/1250] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:36:39 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:36:44.781686 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:36:50.161674 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=14 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:37:21.715784 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db admin admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:37:21.717245 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:37:21.787318 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2b6e9-2318-4be2-be55-7a1c00d7c2db admin admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:37:21.790917 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dc185-13f2-4f94-ae80-fd1d7ac1fcda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d3ab73e09b4d94b06df7eaf1d8b85e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:37:21.791519 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dc185-13f2-4f94-ae80-fd1d7ac1fcda service neutron] REQUEST_METHOD: `GET` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:37:21.791798 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dc185-13f2-4f94-ae80-fd1d7ac1fcda service neutron] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:37:21.792071 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dc185-13f2-4f94-ae80-fd1d7ac1fcda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:37:21.793828 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-8f0dc185-13f2-4f94-ae80-fd1d7ac1fcda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:37:21.855834 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dc185-13f2-4f94-ae80-fd1d7ac1fcda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:37:21.857318 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dc185-13f2-4f94-ae80-fd1d7ac1fcda service neutron] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:37:21.867503 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 612/1251] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:37:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:37:28.732138 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8d8a1-53b8-4a50-b69a-f1f316cf1c93 service placement] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:37:28.733967 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-5cc8d8a1-53b8-4a50-b69a-f1f316cf1c93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:37:28.747932 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8d8a1-53b8-4a50-b69a-f1f316cf1c93 service placement] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:37:28.753175 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66b812-462d-4440-8886-3addb2528600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:37:28.753827 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66b812-462d-4440-8886-3addb2528600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:37:28.754104 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66b812-462d-4440-8886-3addb2528600 admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:37:28.754377 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66b812-462d-4440-8886-3addb2528600 admin admin] PATH_INFO: `/v3/users/99695a3ad43943dcbb8d32b57abafce7` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:37:28.755492 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66b812-462d-4440-8886-3addb2528600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99695a3ad43943dcbb8d32b57abafce7)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:37:28.757602 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66b812-462d-4440-8886-3addb2528600 admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:37:28.946697 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-1c66b812-462d-4440-8886-3addb2528600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99695a3ad43943dcbb8d32b57abafce7'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:28.953803 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-1c66b812-462d-4440-8886-3addb2528600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99695a3ad43943dcbb8d32b57abafce7'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:28.954468 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-1c66b812-462d-4440-8886-3addb2528600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99695a3ad43943dcbb8d32b57abafce7'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:29.012215 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-1c66b812-462d-4440-8886-3addb2528600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99695a3ad43943dcbb8d32b57abafce7'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:29.013013 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-1c66b812-462d-4440-8886-3addb2528600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99695a3ad43943dcbb8d32b57abafce7'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:29.030660 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 640/1252] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Aug 19 01:37:28 2022] DELETE /identity/v3/users/99695a3ad43943dcbb8d32b57abafce7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:37:29.293400 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dc185-13f2-4f94-ae80-fd1d7ac1fcda service neutron] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:37:29.306098 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dc185-13f2-4f94-ae80-fd1d7ac1fcda service neutron] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:37:29.371403 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b045b-509a-4096-9a2e-21d5b0dcab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:37:29.372103 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b045b-509a-4096-9a2e-21d5b0dcab24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:37:29.372390 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b045b-509a-4096-9a2e-21d5b0dcab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:37:29.372666 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b045b-509a-4096-9a2e-21d5b0dcab24 admin admin] PATH_INFO: `/v3/projects/f9a1cb2ce89a47a0b3ec7c55ce9d9b25` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:37:29.373982 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b045b-509a-4096-9a2e-21d5b0dcab24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a1cb2ce89a47a0b3ec7c55ce9d9b25)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:37:29.376020 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b045b-509a-4096-9a2e-21d5b0dcab24 admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:37:29.498999 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:37:29.505267 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-f61b045b-509a-4096-9a2e-21d5b0dcab24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a1cb2ce89a47a0b3ec7c55ce9d9b25', 'request_id': 'req-f61b045b-509a-4096-9a2e-21d5b0dcab24'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:29.510650 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-f61b045b-509a-4096-9a2e-21d5b0dcab24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a1cb2ce89a47a0b3ec7c55ce9d9b25', 'request_id': 'req-f61b045b-509a-4096-9a2e-21d5b0dcab24'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:29.629559 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-f61b045b-509a-4096-9a2e-21d5b0dcab24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a1cb2ce89a47a0b3ec7c55ce9d9b25', 'request_id': 'req-f61b045b-509a-4096-9a2e-21d5b0dcab24'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:29.641221 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-f61b045b-509a-4096-9a2e-21d5b0dcab24 admin admin] The token cache is being invalidate because project f9a1cb2ce89a47a0b3ec7c55ce9d9b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88725) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 01:37:29.641552 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-f61b045b-509a-4096-9a2e-21d5b0dcab24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:29.642655 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-f61b045b-509a-4096-9a2e-21d5b0dcab24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:29.644349 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 613/1253] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Aug 19 01:37:29 2022] DELETE /identity/v3/projects/f9a1cb2ce89a47a0b3ec7c55ce9d9b25 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:37:29.648348 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66b812-462d-4440-8886-3addb2528600 admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:37:29.650049 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-1c66b812-462d-4440-8886-3addb2528600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:37:29.663440 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66b812-462d-4440-8886-3addb2528600 admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:37:29.723138 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037c69e-8d17-47b3-b363-44b3f94da218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:37:29.723766 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037c69e-8d17-47b3-b363-44b3f94da218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:37:29.724046 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037c69e-8d17-47b3-b363-44b3f94da218 admin admin] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:37:29.724317 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037c69e-8d17-47b3-b363-44b3f94da218 admin admin] PATH_INFO: `/v3/users/d006c20be0374f19a8dcbad86bdf55b7` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:37:29.725560 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037c69e-8d17-47b3-b363-44b3f94da218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d006c20be0374f19a8dcbad86bdf55b7)` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:37:29.727461 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037c69e-8d17-47b3-b363-44b3f94da218 admin admin] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:37:29.923830 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-4037c69e-8d17-47b3-b363-44b3f94da218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd006c20be0374f19a8dcbad86bdf55b7'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:29.930911 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-4037c69e-8d17-47b3-b363-44b3f94da218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd006c20be0374f19a8dcbad86bdf55b7'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:29.931586 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-4037c69e-8d17-47b3-b363-44b3f94da218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd006c20be0374f19a8dcbad86bdf55b7'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:29.995159 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-4037c69e-8d17-47b3-b363-44b3f94da218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd006c20be0374f19a8dcbad86bdf55b7'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:29.995769 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.notifications [None req-4037c69e-8d17-47b3-b363-44b3f94da218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd006c20be0374f19a8dcbad86bdf55b7'} {{(pid=88726) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:30.003916 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:37:30.013812 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 641/1254] 10.222.0.82 () {58 vars in 1224 bytes} [Fri Aug 19 01:37:29 2022] DELETE /identity/v3/users/d006c20be0374f19a8dcbad86bdf55b7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 01:37:30.249230 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b045b-509a-4096-9a2e-21d5b0dcab24 admin admin] Authenticating user token {{(pid=88725) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:37:30.252876 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.fernet_utils [None req-f61b045b-509a-4096-9a2e-21d5b0dcab24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88725) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:37:30.265346 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b045b-509a-4096-9a2e-21d5b0dcab24 admin admin] Validating token access rules against request {{(pid=88725) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:37:30.323121 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd2f7e-4931-49d3-9a32-08bb78716ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e416b080ca43b493d7d04aa867adf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd377ed4c2f045fc8b576211274579df', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88725) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:37:30.323810 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd2f7e-4931-49d3-9a32-08bb78716ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:37:30.324007 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd2f7e-4931-49d3-9a32-08bb78716ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:37:30.324286 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd2f7e-4931-49d3-9a32-08bb78716ba9 admin admin] PATH_INFO: `/v3/projects/82c77061f3a744ba833f737a98288bdb` {{(pid=88725) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:37:30.325446 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd2f7e-4931-49d3-9a32-08bb78716ba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82c77061f3a744ba833f737a98288bdb)` {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:37:30.327358 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd2f7e-4931-49d3-9a32-08bb78716ba9 admin admin] RBAC: Authorization granted {{(pid=88725) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:37:30.444574 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-33dd2f7e-4931-49d3-9a32-08bb78716ba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82c77061f3a744ba833f737a98288bdb', 'request_id': 'req-33dd2f7e-4931-49d3-9a32-08bb78716ba9'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:30.450069 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-33dd2f7e-4931-49d3-9a32-08bb78716ba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82c77061f3a744ba833f737a98288bdb', 'request_id': 'req-33dd2f7e-4931-49d3-9a32-08bb78716ba9'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:30.538061 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-33dd2f7e-4931-49d3-9a32-08bb78716ba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82c77061f3a744ba833f737a98288bdb', 'request_id': 'req-33dd2f7e-4931-49d3-9a32-08bb78716ba9'} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:30.551074 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-33dd2f7e-4931-49d3-9a32-08bb78716ba9 admin admin] The token cache is being invalidate because project 82c77061f3a744ba833f737a98288bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88725) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 01:37:30.551364 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-33dd2f7e-4931-49d3-9a32-08bb78716ba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:30.552029 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG keystone.notifications [None req-33dd2f7e-4931-49d3-9a32-08bb78716ba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88725) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 01:37:30.553614 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: [pid: 88725|app: 0|req: 614/1255] 10.222.0.82 () {58 vars in 1233 bytes} [Fri Aug 19 01:37:30 2022] DELETE /identity/v3/projects/82c77061f3a744ba833f737a98288bdb => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 01:37:40.103715 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:37:40.546658 dv-osbrick-852824-2-ceph devstack@keystone.service[88725]: DEBUG dbcounter [-] [88725] Writing DB stats keystone:SELECT=60,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 01:41:45.908096 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037c69e-8d17-47b3-b363-44b3f94da218 admin admin] Authenticating user token {{(pid=88726) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 01:41:45.909518 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-4037c69e-8d17-47b3-b363-44b3f94da218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:41:46.034160 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037c69e-8d17-47b3-b363-44b3f94da218 admin admin] Validating token access rules against request {{(pid=88726) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 01:41:46.091249 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f67e09-68c2-4d36-b397-26a981111a06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '246b63ecc51347f08daad24d75e3de27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38e380f92824682a8286e59af2fc23c', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88726) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 01:41:46.092345 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f67e09-68c2-4d36-b397-26a981111a06 service placement] REQUEST_METHOD: `GET` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 01:41:46.092622 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f67e09-68c2-4d36-b397-26a981111a06 service placement] SCRIPT_NAME: `/identity` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 01:41:46.092919 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f67e09-68c2-4d36-b397-26a981111a06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88726) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 01:41:46.094659 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.fernet_utils [None req-88f67e09-68c2-4d36-b397-26a981111a06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88726) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 01:41:46.105358 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f67e09-68c2-4d36-b397-26a981111a06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 01:41:46.106946 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f67e09-68c2-4d36-b397-26a981111a06 service placement] RBAC: Authorization granted {{(pid=88726) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 01:41:46.116791 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: [pid: 88726|app: 0|req: 642/1256] 10.222.0.82 () {60 vars in 1365 bytes} [Fri Aug 19 01:41:45 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 01:41:56.112906 dv-osbrick-852824-2-ceph devstack@keystone.service[88726]: DEBUG dbcounter [-] [88726] Writing DB stats keystone:SELECT=84 {{(pid=88726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}